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ADDENDUM 


The  work  reported  by  R.  J.  Massa  in  this  issue  of  the 
Bulletin   was  performed  as  a  part  of  his  doctoral  dissertation 
at  the  Massachusetts  Institute  of  Technology,  and  was  essen- 
tially completed  in  June,  1961.   More  recent  work  is  reported 
by  him  in  "The  Role  of  Short-Term  Visual  Memory  in  Visual  In- 
formation Processing,"  in  W.  Wathen-Dunn  (ed.).  Models    for    the 
Perception    of  Speech   and    Visual    Form    (Cambridge:  MIT  Press, 
1967,  pp.  171-9).   This  research  was  completed  in  1964.   It  is 
possible — perhaps  even  likely — that  many  of  the  concepts  and 
views  presented  have  been  superseded  through  the  results  of 
more' recent  studies.   Still,  short-term  visual  memory  and  re- 
lated sensory  information  processing  remain  interesting,  im- 
portant, and  largely  unexplained  aspects  of  human  sensory 
operation. 

The  author  wishes  to  thank  the  American  Foundation  for 
the  Blind  and  its  publication  staff  for  their  interest  in  this 
manuscript  and  their  assistance  in  editing  and  preparing  it 
for  publication. 


ERRATA 

On  page  61  of  Bulletin   No.  15  ("Factors  Associated  with 
Intellectual  Variation  Among  Visually  Impaired  Children") 
John  Felty  should  have  been  identified  as  a  National  Defense 
Education  Act  doctoral  fellow  in  Special  Education  at  Michigan 
State  University  while  the  research  was  being  completed. 


TOWARDS  A  UNIFIED  APPROACH  TO  THE  MOBILITY 
OF  BLIND  PEOPLE* 


J.  A.  Leonard 

Medical  Research  Council,  Department  of  Psychology, 

University  of  Nottingham 


This  is  an  attempt  to  clarify  and  consolidate  contemporary 
ideas  about  mobility  of  the  blind.   In  Part  I,  an  agreed  aim  is 
stated,  an  appropriate  attitude  is  suggested,  and  three  standards 
for  comparison  are  laid  down.   The  different  groups  of  people 
required  to  cooperate  in  achieving  the  desired  aim  are  listed 
and  four  roles  of  research  are  specified.   In  Part  II,  a  check- 
list of  requirements  and  resources  is  introduced  and  amplified. 
Part  III  looks  speculatively  at  the  future. 

Since  this  paper  is  addressed  to  those  personally  or  pro- 
fesionally  connected  with  the  problems   of  blindness  much  of  the 
background  has  been  assumed,  but  some  references  for  general 
reading  are  provided  in  the  bibliography.   All  the  same  it  is 
necessary  to  make  one  point  clear.   Frequent  reference  will  be 
made  to  "the  blind"  as  an  apparently  homogeneous  population.   We 
all  know  that  this  is  not  true  in  many  respects:  blind  people 
differ  among  themselves  as  much  as  sighted  people  but  they  do 
all  share  the  common  disability  of  severely  impaired  or  completely 
absent  vision.   We  also  know  that  even  on  that  common  ground 
there  are  many  variations  in  kind  and  degree:  people  may  be  born 
blind  or  become  blind  in  later  life,  people  differ  in  the  amounts 
of  residual  vision,  and  they  differ  in  the  extent  of  additional 
impairment.   But  if  we  do  want  to  attempt  any  form  of  systemisa- 
tion,  it  has  been  found  useful  to  concentrate  on  similarities 

'^This    paper   was    published   by    the    Southern    Regional   Associa- 
tion   for    the    Blind    in    Blind  Welfare:  Southern  Regional  Review, 
No.     40,    September,    1966. 

In    1965    the    Medical    Research    Council   made    a    five    year 
grant    to    the    Department    of  Psychology    at    Nottingham    University 
to    study   more   generally    problems    of  mobility    of   the    blind.       This 
work    was    headed   by    Dr.    J.    A.    Leonard,    who   was    already    well    known 
within    the   region    through    lectures    and   discussions    at    Conferences 
and   Refresher    Courses    organized   by    the   Association.       Dr.    Leonard 
developed   his    interest    in   mobility    of   blind   people    in    1962    while 
at    the   MRC   Applied   Psychology    Research    Unit    at    Cambridge ,    and 
was    asked    to    evaluate    Snoic   Aids.       In    1964    he    took    a    study    trip 
to    the    United   States    to    learn   more    of  Long    Cane    and   Orientation 
Training . 


rather  than  differences.  It  may  seem  paradoxical,  but  up  to  a 
point  science  can  best  serve  the  individual  by  seeking  out  the 
common  denominators,  as  long  as  one  does  not  forget  that  those 
whom  we  seek  to  serve  ultimately  are  unique  individuals. 

Those  who  are  concerned  with  welfare  undoubtedly  also 
have  to  use  the  concept  of  the  common  denominator  for  practical 
purposes.   But  perhaps  it  is  the  different  amounts  of  emphasis 
on  the  needs  of  a  particular  individual  which  may  serve  as  one 
of  the  distinguishing  characteristics  between  welfare  and  re- 
search. 


PART  I:  AN  AGREED  AIM  STATED 

The    agreed   aim:    To  integrate  the  blind  population  com- 
pletely with  the  sighted  implies  that  the  blind  should  be  able 
to  achieve  the  same  degree  of  independent  mobility  as  that  en- 
joyed by  the  sighted.   In  practice  this  means  that  one  aims  at 
minimising  the  differences  between  the  two  as  far  as  possible. 

An    appropriate    attitude:    It  is  submitted  that  in  order  to 
achieve  this  aim  it  is  essential  that  all  those  concerned  should 
take  the  view  that  maximum  mobility  is  an  inalienable  right  of 
the  blind  as  much  as  of  the  sighted,  and  not  a  matter  of  privi- 
lege.  In  practice  this  means  that  every  blind  person  should  be 
provided  with  every  reasonable  opportunity  to  achieve  a  maximum 
degree  of  independence.   Facilities  to  acquire  maximum  mobility 
should  therefore  be  provided  as  a  matter  of  routine  and  not  mere- 
ly on  demand.   These  facilities  should  embrace  all  the  known  and 
proved  resources  and  they  should  be  applied  with  a  view  towards 
improving  mobility  rather  than  favouring  one  method  to  the  exclu- 
sion of  all  others.   It  is  this  attitude  of  mind  by  all  concerned 
which  is  by  far  the  most  important  single  determining  factor  in 
achieving  the  agreed  aim. 

Standards    for   oomparison :    If  one  wishes  to  assess  the  level 
of  achievement  present  in  any  field  one  must  have  some  standards 
for  comparison  and  establish  some  sort  of  a  scale.   As  far  as  mo- 
bility is  concerned  such  a  scale  is  fixed  at  two  points.   At  one 
end  there  is  the  completely  homebound  individual  while  at  the 
other  end  there  is  the  blind  person  who  is  no  different  from  the 
sighted  person.   If  one  takes  the  bottom  end  of  the  scale  as  a 
standard  for  comparison,  relatively  low  levels  of  observed 
achievement  will  obviously  be  regarded  as  considerable  progress. 
If  one  opts  for  the  top  end,  achievements  at  present  beyond  our 
reach  would  have  to  be  observed. 

It  is  submitted  that  there  is  an  intermediate  standard 
which  has  at  least  two  useful  properties:  it  can  be  reached  and 
it  can  be  adjusted  periodically.   For  practical  purposes  it  is 
suggested  that  one  takes  as  a  standard  for  comparison  the  highest 
degrees  of  mobility  which  can  be  achieved  by  the  best  existing 
means.   That  is  to  say,  one  finds  out  what  is  a  present  best. 


albeit  for  the  best  only  at  present,  and  seeks  to  bring  the  ma- 
jority of  the  population  up  to  that  standard.   As  more  experi- 
ence and  knowledge  accumulate,  the  standard  can  be  updated  as 
required  so  that  there  is  no  inherent  danger  of  the  process  be- 
coming stationary  until  the  aim  is  achieved. 

Required   aoopevation :    In  order  to  achieve  the  intermediate 
and  final  aims  the  cooperation  of  all  concerned  is  required:  the 
blind  themselves  in  the  first  instance,  their  relatives,  the  home 
teachers,  voluntary  organisations,  schools,  the  sighted  popula- 
tion, and  research.   It  would  not  be  appropriate  for  one  outside 
most  of  these  areas  to  specify  the  roles  of  others  concerned,  at 
least  at  this  stage.   The  role  of  research  can  be  considered 
under  four  headings: 

1.  To  assess  the  present  state  and  level  of  blind  mobility 
in  the  country; 

2.  To  examine  objectively  and  without  prejudice  all  and 
any  existing  methods;  to  compare  the  degree  of  success  attained 
by  such  methods  having  due  regard  to  the  fact  that  some  methods 
may  benefit  one  group  of  people  more  than  others,  and  that  the 
use  of  any  single  method  need  not  exclude  the  use  of  others  in 
combination; 

3.  To  disseminate  information  to  all  concerned--that  is, 
those  listed  above; 

4.  To  extend  the  degree  of  mobility  until  the  final  aim  is 
achieved. 

This  may  be  a  tall  order,  and  indeed  it  is  when  one  con- 
siders the  resources  available.   For  quite  apart  from  a  great 
deal  of  observation  of  blind  people  moving  through  traffic  of 
all  kinds,  research  has  to  be  directed  towards  fundamental  is- 
sues and  the  development  of  methodology.   It  is  therefore  not  at 
all  surprising  that  whenever  others  are  prepared  to  take  on  some 
of  the  many  tasks  planned  for  research  those  concerned  welcome 
this  shedding  of  the  load.   Always  provided  that  there  can  be 
some  measure  of  sharing  of  activities  and  results. 

Having  said  this,  it  is  important  to  realise  the  contem- 
porary nature  of  research  techniques  and  the  means  available  to 
assess  achievements.   The  crux  of  the  matter  is  that  one  aims  at 
measuring  performance  as  well  as  assessing  opinions.   It  is  one 
thing  to  know  that  a  certain  method  can  be  shown  to  achieve 
specified  results  by  a  group  of  people--it  is  quite  another  to 
find  acceptance  for  a  new  method.   It  is  very  important  to  have 
people's  opinions,  but  they  can  be  very  misleading  in  giving  en- 
thusiastic approval  as  well  as  in  registering  complete  rejection. 
The  ultimate  test  of  any  new  method  is  clearly  the  extent  to 
which  it  gains  acceptance  among  a  group  of  people ,  but  there  are 
many  routes  towards  ultimate  acceptance  and  rejection. 


Realisation  of  this  is  perhaps  more  important  with  respect 
to  the  response  to  innovations  by  the  blind  than  to  many  other 
groups  of  people.   Take  the  case  of  the  long  cane  as  a  recent 
example.   A  sighted  observer  could  form  an  opinion  about  the 
long  cane  by  observing  those  already  trained  and  comparing  their 
performance  with  that  achievable  by  other  blind  travellers.   The 
only  way  in  which  a  blind  person  could  form  an  opinion  directly 
was  by  having  some  experience  of  it,  and  the   only  way  in  which 
it  is  possible  to  have  useful  experience  of  the  long  cane  is  to 
be  trained  by  an  experienced  instructor.   It  is  good  to  know  that 
there  are  now  a  number  of  blind  people  in  this  country  who  have 
had  this  experience,  and  even  better  that  there  is  every  likeli- 
hood of  their  number  being  increased  presently. 

PART  II:  THE  REQUIREMENTS  AND  RESOURCES 
FOR  MOBILITY 

It  is  a  cardinal  principle  of  all  forms  of  rehabilitation 
or  training  for  disabled  people  that  one  should  utilise  the  re- 
maining abilities  of  each  person  concerned  to  the  fullest  extent 
possible.   I  fully  agree  with  this  principle  which  carries  the 
implication  that  any  aids  to  reduce  the  disability  should  be  as 
simple  and  direct  as  possible,  and  that  only  as  a  last  resort 
should  one  go  for  solutions  of  higher  levels  of  complexity.   Hav- 
ing said  this  I  want  to  add  the  following  qualifications: 

Although  a  disabled  person  may  be  able  to  carry  out  a  par- 
ticular function,  such  as  obstacle  detection,  with  one  of  the 
remaining  senses  and  should  be  encouraged  to  do  so,  there  is  no 
reason  why  he  should  not  also  be  provided  with  an  additional 
means.   For  up  to  a  point  the  more  one  can  learn  about  the  en- 
vironment from  different  sources  of  information,  the  better,  if 
only  because  one  of  the  sources  may  have  limited  usefulness 
only:  for  example,  many  people  with  relatively  high  degrees  of 
residual  vision  can  only  make  use  of  this  under  suitable  condi- 
tions of  illumination,  become  functionally  blind  when  these  condi- 
tions are  not  met,  and  could  benefit  from  training  "as  if"  to- 
tally blind  to  cope  with  those  situations. 

Secondly,  there  are  situations  which  cannot  be  dealt  with 
by  the  remaining  senses  however  well  these  are  developed  or 
trained:  it  is  practically  impossible  for  a  totally  blind  per- 
son to  obtain  adequate  and  timely  warning  of  obstacles  at  the 
level  below  the  knees  by  his  remaining  senses  alone.   Without 
some  additional  aid  it  is  virtually  impossible  for  such  a  person 
to  move  in  acceptable  safety  and  at  reasonable  speed  through 
traffic,  however  familiar  the  route. 

The  following  table  (Table  1)  was  constructed  to  enable 
one  to  grasp  at  a  glance  how  present  needs  in  mobility  are  met 
by  existing  resources.   This  kind  of  checklist  is  used  a  great 
deal  these  days  by  those  concerned  with  the  design  of  systems 
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of  many  kinds.   It  is  based  on  the  notion  that  it  is  possible  to 
specify  the  requirements  of  a  situation  in  some  detail  and  to 
allocate  functions  to  the  resources  available.   It  is  used  either 
to  discuss  classes  of  systems — which  is  the  way  I  am  using  it 
here — or  else  for  individual  instances.   You  could  copy  out  this 
Table  and  apply  it  to  any  of  the  cases  in  your  care  to  establish 
what  they  can  and  cannot  be  expected  to  do.   Taken  together  with 
the  rating  scale  in  Appendix  B  such  a  procedure  may  enable  you 
to  pinpoint  more  readily  the  source  of  difficulties  experienced. 
I  offer  such  a  suggestion  with  a  great  deal  of  humility  and  dif- 
fidence, for  I  am  well  aware  that  checklists  of  this  kind  may  not 
be  of  much  help  to  those  with  experience  of  blind  people  who  may 
have  learned  to  recognise  individual  difficulties  much  more  easily 
than  an  outsider  like  myself.   Moreover,  such  a  checklist  cannot 
pretend  to  cope  with  all  contingencies,  certainly  not  at  this 
early  stage  of  development.   Nevertheless,  it  may  be  helpful  to 
be  able  to  tick  off  the  more  obvious  sources  of  trouble  before 
establishing  more  subtle  causes  of  malfunction. 

Before  discussing  the  contents  of  Table  1  it  seems  essen- 
tial to  stress  two  points: 

1.  This  Table  deals  with  the  present  situation  and  not 
with  any  future  solutions.   Ultimately  no  doubt  science  will 
eliminate  blindness  by  a  two-fold  attack:  preventative  medicine 
will  go  a  long  way  towards  eliminating  the  causes  of  blindness 
and  "spare  part  surgery"  may  present  us  with  functioning  artifi- 
cial sense-organs,  nerve-fibres,  and  relevant  bits  of  central 
nervous  structure.   Both  these  achievements  are  a  good  way  off, 
but  not  so  far  that  those  interested  can  afford  to  keep  their 
eyes  off  the  ball:  however,  as  far  as  the  present  state  of  the 
art  of  spare  part  surgery  is  concerned  it  is  as  well  to  realise 
that  one  is  only  just  beginning  to  be  able  to  "replace"  organs 
of  the  body  which  are  largely  under  involuntary  control,  rela- 
tively simple  in  the  modes  of  operation  and,  most  important, 
where  the  basic  principles  of  operation  are  reasonably  well 
understood . 

2.  Inevitably  at  present  there  is  a  need  for  formal  and 
extensive  training  for  mobility.   Indeed,  on  the  basis  of  the 
present  evidence,  it  is  only  reasonable  to  assume  that  even  when 
functioning  artificial  eyes  can  be  produced  there  would  be  a 
longish  period  of  "learning  to  see"  at  least  for  the  congenitally 
blind.   I  know  well  that  there  is  a  great  reluctance  among  all  of 
us  to  have  to  undergo  long  terms  of  training  for  any  task.   One 
wants  to  be  sure  that  the  effort  required  will  somehow  be  com- 
mensurate with  the  achievement  to  be  obtained.   At  present  many 
blind  people  are  less  bothered  by  slow  and  stumbling  progress 
than  by  the  prospect  of  having  to  spend  four  weeks  of  intensive 
mobility  training.   This  is  a  fact  of  life  which  you  have  to  deal 
with  to  a  greater  extent  than  I,  for  in  the  last  resort  my  task 
is  primarily  to  demonstrate  with  those  who  are  willing  what  can 


be  achieved.   But  I  am  willing  to  bet  that  those  of  you  who 
have  seen  efficient  guide  dog  travel  or  who  will  be  seeing 
•  efficient  Long  Cane  travel  will  have  a  standard  to  set  before 
those  in  your  care  which  they  may  well  find  worth  spending 
some  time  in  acquiring. 

Requirements 

Down  one  side  of  the  Table  are  listed  a  number  of  re- 
quirements in  four  large  groups:  the  first  are  general  require- 
ments, the  second  deals  with  perception,  the  third  with  obstacle 
detection,  and  the  fourth  with  navigation. 

(a)  Attitude,  standards,  and  motivation  are  obviously  the 
most  basic  requirements.   I  wholeheartedly  agree  with  those  who 
maintain  that  a  person  has  to  be  motivated  to  become  mobile. 
But  I  would  add  that  the  knowledge  of  what  can  be  achieved  by 
most  people  will  in  itself  provide  a  certain  amount  of  that 
motivation.   Once  blind  people  can  be  m.ade  to  accept  that 
bumbling  and  stumbling  need  not  be  inevitable  concomitants 
of  independent  mobility  their  attitude  may  be  changed  as  much 
as  those  of  older  people  who  used  to  accept  a  degree  of  blind- 
ness as  an  inevitable  concomitant  of  old  age. 

A  sense  of  the  position  of  one's  body  in  space,  and  of 
one's  limbs  in  relation  to  one's  body  is  likely  to  be  an  im- 
portant precondition  to  good  mobility  on  theoretical  grounds. 
Thus  people  with  additional  handicaps  affecting  this  experience 
might  find  it  hard  to  become  fully  mobile.   But  we  know  very 
little  about  this  as  yet. 

(b)  We  divide  perception  into  two  classes:  near   perception 
deals  with  everything  which  is  sensed  directly  by  the  body  sur- 
face, for  all  practical  purposes  this  means  the  senses  of  touch 
and  pressure.  Distant   perception    is  served  by  vision,  hearing 
and  smell,  that  is,  the  senses  which  enable  us  to  perceive  ob- 
jects without  having  to  come  in  contact  with  them. 

(c)  Obstacle  detection:  it  is  useful  to  consider  the  three 
zones  which  have  to  be  protected:  head,  body,  and  feet,  as  long 
as  one  does  not  draw  the  dividing  lines  too  sharply. 

I  have  put  "street  crossing"  under  obstacle  avoidance  be- 
cause the  crossing  of  streets  is  at  present  the  single  largest 
remaining  class  of  obstacles.   It  is  difficult  enough  for  the 
sighted  to  cope  with  the  rising  traffic,  for  the  blind  there 
are  two  identifiable  sources  of  difficulty: 

1.  The  blind  traveller  unguided  cannot  deal  with  the  two 
opposing  streams  of  traffic  separately  by  clearing  near  traffic 
first,  waiting  in  the  middle  of  the  road,  and  clearing  distant 
traffic  next:  if  he  ventures  forth  at  all,  the  crossing  has  to 
be  carried  out  in  one  fell  swoop.   This  may  mean  that  one-way 
streets  are  easier  to  deal  with  by  blind  travellers  since  they 
only  have  to  take  account  of  traffic  coming  from  one  direction. 
Were  it  not  for  the  fact  that  one-way  streets  tend  to  have 


higher  average  traffic  speeds  one  might  consider  them  as  pref- 
erable for  blind  crossing.   We  hope  to  find  out  more  about  this. 

2.  The  blind  traveller  does  not  have  any  opportunity  of 
communicating  with  drivers  of  cars  by  "eye  contact"  as  does  the 
sighted  pedestrian.   It  is  perhaps  not  realised  how  much  the 
sighted  "talk  to  each  other  only  with  their  eyes"  on  these  oc- 
casions, and  the  facilitation  which  this  provides. 

(d)  Navigation:  basically  we  are  talking  here  of  routes, 
landmarks,  judgments  of  time  and  of  distance.   By  the  require- 
ment "routes"  is  meant  some  form  of  memorised  pattern,  descrip- 
tion, map,  etc.,  of  a  complete  route  or  set  of  routes.   "Land- 
marks" refers  to  the  need  to  handle  a  wide  range  of  landmarks, 
for  example,  the  end  of  blocks,  pillarboxes,  smells,  noises, 
etc.   Because  we  are  beginning  to  get  to  know  something  about 
them  in  detail  I  have  listed  four  classes  which  appear  to  be 
particularly  useful:  slope,  veer,  curvature,  and  texture. 

Speed  here  refers  to  either  detection  or  speed  of  movement 
in  as  much  as  these  are  interdependent.   You  will  not  find  many 
references  to  a  speed  requirement  in  the  relevant  literature 
until  quite  recently.   The  explicit  requirement  that  blind  travel 
should  "be  at  speeds  comparable  to  that  of  the  sighted  marks  the 
biggest  break  with  the  traditional  approach  to  blind  travel  be- 
cause it  draws  attention  to  the  slowness  of  most  blind  persons' 
progress.   Purely  arbitrarily  I  am  proposing  here  three  speed 
categories:  slow  =  1  mph,  medium  =  2  mph ,  and  fast  =  anything 
better  than  that.   It  is  reasonable  to  assume  that  ordinary 
pedestrian  traffic  is  about  between  2  and  3  mph.   Entries  along 
these  rows  refer  to  the  possibility  of  travelling  safely  at 
these  speeds. 

Resources 

Along  the  top  of  the  Table  are  listed  the  resources  avail- 
able.  They  can  be  considered  under  two  broad  headings:  resources 
provided  as  it  were,  from  within  the  individual,  and  those  pro- 
vided by  the  utilisation  of  aids  of  various  kinds. 

The  first  group  is,  again,  very  general:  a  sound  mind  and 
body  are  useful  resources  to  bring  to  the  task. 

Person  (i) 

Memory :    The  psychologist  considers  this  often  separately 
for  short-term  and  long-term  use  and  tests  for  either  exist. 
Just  how  useful  they  are  in  relation  to  our  present  problem  re- 
mains to  be  seen. 

Residual  vision:  This  covers  the  range  from  anything  bet- 
ter than  no  perception  of  light  to  the  upper  limit  of  registra- 
tion for  blindness.  The  argument  ranges  largely  about  the  uses 
to  be  made  of  residual  vision:  should  one  encourage  or  discour- 
age its  use,  should  one  allow  people  to  find  their  own  way  of 


making  good  use  of  it,  should  one  try  to  teach  methods  of  uti- 
lising residual  vision  most  adequately  in  relation  to  other  re- 
sources?  One  of  the  main  points  to  remember  is  that  the  use- 
fulness of  residual  vision  is  often  severely  limited  by  condi- 
tions of  illumination  and  other  factors.   Another  point  to  bear 
in  mind  here,  as  with  any  of  the  other  resources,  is  the  possi- 
bility of  allowing  them  to  complement  or  assist  each  other:  a 
blind  person  with  very  restricted  field  vision  in  one  eye  can 
be  taught  to  use  this  for  forward  vision — that  is,  obstacle  de- 
tection and  steering,  while  using  a  cane  to  ensure  safety  at 
foot  level. 

Touch:    Strictly  speaking  this  includes  all  the  so-called 
near-receptors — that  is,  pressure  and  joint  senses.   They  are 
considered  to  be  the  most  elementary  of  our  senses.   They  do 
not  allow  one  to  receive  a  great  variety  of  shades  of  stimula- 
tion compared  with  the  eye,  and  they  adapt  very  rapidly  to 
stimulation — that  is,  they  very  rapidly  cease  to  signal  messages 
to  the  brain  in  the  presence  of  continued  stimulation;  hence  one 
does  not  feel  the  pressure  of  one's  clothes  for  any  length  of 
time  after  putting  them  on.   These  senses  are  therefore  poor 
"pattern"  receptors  as  far  as  conscious  perception  is  concerned 
while  at  the  level  below  consciousness  it  is  these  senses  which 
tell  us  continuously  and  pretty  accurately  about  the  position 
of  our  limbs  in  relation  to  the  rest  of  the  body,  and  so  on. 

Perhaps  a  good  point  to  remember  is  that  it  is  much  harder 
to  deceive  the  sense  of  touch  than  the  other  senses,  and  that 
we  tend  to  use  it  to  resolve  perceptual  conflicts  produced  by 
the  other  senses. 

Hearing :    This  sense,  like  touch,  is  predominantly  used  to 
take  in  information  of  a  sequential  kind  rather  than  simultane- 
ously presented  patterns:  the  main  characteristic  of  speech  is 
just  this  sequential  character.   The  ear  and  the  parts   of  the 
brain  associated  with  it,  have  evidently  been  developed  to  a 
fine  point  to  deal  with  just  this  kind  of  task.   We  can  convey 
a  great  deal  of  information  through  hearing  provided  it  is  of  a 
speechlike  nature  and  utilises  the  sequential  basis  of  the  mecha- 
nisms provided.   Hearing,  being  served  by  two  sense-organs  placed 
on  either  side  of  the  head,  does  allow  us  to  perceive  "in  depth," 
to  make  judgments  of  distance,  direction  of  sound  sources,  and 
the  nature  of  their  movement  in  relation  to  ourselves  or  other 
sound  sources.   Within  limits  our  auditory  mechanism  can  deal 
with  some  of  the  information  needed  for  a  crude  form  of  echo- 
location  and  it  is  pretty  certain  that  this  is  how  "facial  vision" 
is  brought  about.   But  in  general  all  the  sorts  of  discriminations 
required  for  adequate  spatial  orientation  are  badly  served  in  the 
auditory  system  of  humans  as  compared  with  other  animals.   On 
the  other  hand,  what  there  is  can  be  used  to  good  effect,  and 
can  be  trained  to  become  better.   In  practice  it  is  well  worth 
noting  that  however  good  a  blind  person's  "facial  vision,"  he 


will  move  past  obstacles  by  giving  them  a  considerably  wider 
berth  than  is  strictly  speaking  necessary. 

Hearing,  then,  is  obviously  one  of  the  most  important  re- 
sources available  to  the  blind  person;  without  it  life  becomes 
markedly  and  drastically  more  difficult.   Hence  it  is  important 
to  ensure  that  a  blind  person's  hearing  is   kept  in  a  good  state 
of  repair  basically,  augmented  by  suitable  hearing  aids  if  neces- 
sary (binaural  where  necessary) ,  and  that  methods  of  training 
for  better  hearing  are  studied  and  made  known. 

In  summing  up  on  the  senses  it  is  important  to  realise  that 
one  has  to  think  of  them  in  relation  to  the  parts  of  the  brain  to 
which  they  feed  information  and  to  the  whole  brain  structure  in 
turn.   In  man  the  visual  system  predominates  over  all  others,  in 
bats  it  is  the  auditory  system  which  almost  crowds  out  everything 
else  in  a  small  but  very  effective  brain  box.   Hence,  even  though 
we  may  feed  man  with  the  same  sort  of  information  as  is  used  by 
a  bat,  it  is  unlikely  that  he  will  ever  be  able  to  achieve  a  bat's 
feats  of  echolocation .   The  senses  which  remain  to  a  blind  person 
in  the  complete  or  partial  absence  of  vision  are  his  first  and 
most  immediate  resources.   They  should  be  taken  great  care  of 
for  with  man's  most  important  information  gathering  system  out 
of  action  their  role  becomes  vastly  more  important. 

The  section  above  has  dealt  with  the  utilisation  of  the  re- 
maining senses.  The  next  class  of  resources  are  those  which  make 
the  blind  person  rely  on  existing  aids  to  a  greater  or  lesser  ex- 
tent: canes,  guiding  by  dogs  or  by  humans. 

Proved  Aids  (ii) 

Short    cane:    Starting  with  an  ordinary  walking  stick  painted 
white  and  progressing  to  the  currently  used  elegant  collapsible 
metal  cane,  this  aid  has  been  with  us  for  some  forty  years.  Apart 
from  its  usefulness  in  extending  the  physical  range  of  the  hand, 
it  serves  as  a  signal  to  other  road  users,  to  draw  attention  to 
the  fact  that  there  is  a  blind  person.   We  all  know  that  it  is 
this  second  feature  which  has  two  sides  to  it:  those  of  us  who 
for  reasons  of  welfare  or  skill  acquisition  wish  to  see  the  blind 
equipped  with  this  aid  realise  the  tremendous  value  of  the  "sig- 
nal," for  it  enables  the  sighted  to  offer  assistance  in  those 
situations  in  which  the  blind  person  cannot  operate  without 
sighted  help,  for  example,  the  crossing  of  busy  streets.   To 
many  of  the  blind  one  suspects  that  the  white  cane  is  still  more 
of  a  necessary  evil  than  a  good  friend;  for  a  variety  of  reasons 
it  is  a  negative  status  symbol.   (A  guide  dog  on  the  other  hand, 
which  is  not  exactly  inconspicuous,  appears  to  be  a  positive 
status  symbol.)   There  is  much  that  can  be  done  with  the  short 
cane  and  its  efficient  use  can  be  taught.   At  the  RNIB's  re- 
habilitation centres  for  instance,  this  now  forms  a  major  part 
of  mobility  training. 
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Long    aane :    This  is  the  aid  forming  the  core  around  which 
the  Hoover  technique  was  built.   It  is  an  aluminium  cane  with  a 
hard  fibre  tip  reaching  to  the  tip  of  the  user's  elbow,  or  the 
bottom  of  the  sternum,  which  makes  it  some  four  to  six  inches 
longer  than  a  walking  stick.   A  walking  stick  is  intended  to 
bear  your  weight  at  the  moment  you  change  from  one  foot  to  the 
other  so  that  it  acts  as  a  sort  of  pivot  touching  the  ground 
straight  in  line  with  your  body.   The  long  cane  is  designed  to 
touch  the  ground  just  one  step  ahead  of  your  body,  sensing  the 
area  in  which  you  are  about  to  set  your  foot.   It  is  this  which 
enables  the  long  cane  traveller  to  walk  with  more  assurance  and 
grace  but  the  extra  length  of  the  cane  makes  it  necessary  to 
adopt  and  acquire  an  appropriate  technique.   The  best  descrip- 
tion of  this  by  a  British  user  has  appeared  in  the  St.    Duns  tan  '  s 
Review   for  April,  1966,  by  Walter  Thornton.   The  crux  of  the 
training  is  the  need  to  incorporate  the  cane  into  the  body 
schema,  to  make  it  as  much  a  part  of  you  as  your  pen,  your  bi- 
cycle, or  your  car — all  tools  which  you  can  use  efficiently  and 
safely  without  having  to  think  about  their  operation  continu- 
ously.  I  have  every  reason  to  believe  that  the  long  cane  and 
its  associated  training  programme  constitute  the  largest  advance 
in  independent  mobility  technique  in  the  last  two  or  three 
decades,  for  it  should  enable  those  who  can  be  trained  to  move 
about  in  considerable  safety.   And  it  looks  quite  possible  that 
those  who  can  be  trained  comprise  a  wide  section  of  the  blind 
population . 

Dog   guide:    Readers  here  will  know  most  of  the  relevant 
facts  about  guide  dogs.   There  are  a  number  of  papers  to  which 
they  can  refer  if  in  any  doubt,  particularly  the  information 
booklets  published  by  the  Guide  Dog  Association.   Here  I  only 
wish  to  stress  the  following  points  of  interest: 

1.  The  special  nature  of  the  necessarily  intimate  relation- 
ship between  the  blind  person  and  the  dog.   The  owner  has  to  be 
able  to  rely  on  the  dog  completely  while  the  dog  is  in  harness, 
but  the  dog  also  has  to  be  able  to  rely  on  the  owner  to  retain 
complete  control.   Both  are  living  creatures  who  have  been  trained 
singly  and  together  to  carry  out  a  special  task.   It  is  in  the 
nature  of  such  training  that  it  has  to  be  "tuned  up"  periodically, 
and  that  both  partners  have  to  prevent  themselves  from  becoming 
distracted  during  work.   Hence,  in  every  sense  of  the  word  this 

is  very  much  a  working  relationship.   It  is  also  almost  inevit- 
ably an  emotional  one . 

2.  The  question  of  independence.   Evidently  while  the 
blind  person  is  working  with  the  dog  they  are  dependent  on  each 
other.   But  a  blind  person  with  a  dog  is  of  course  much  less 
dependent  on  sighted  help,  he  can  cross  roads  with  a  great 
measure  of  safety  for  instance.   The  main  problem  tends  to  arise 
once  the  blind  person  is  not  using  his  dog  for  some  reason  or 
another.   There  is  absolutely  no  reason  why  guide  dog  owners 
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should  not  be  trained  in  other  forms  of  basic  mobility  tech- 
niques as  well,  as  long  as  this  does  not  interfere  with  their 
efficient  cooperation  with  the  dog. 

Z.    The  two  points  mentioned  may  well  go  some  way  towards 
accounting  for  those  blind  persons  who,  although  they  do  not 
want  to  take  up  training,  are  eligible  for  guide  dog  training 
on  the  grounds  of  minimal  vision,  age,  general  fitness,  and 
intelligence:  there  are  clearly  people  who  cannot  enter  into 
the  appropriate  relationship  with  a  dog  (or  with  another  person 
for  that  matter)  and  there  are  people  who  feel  that  their  inde- 
pendence is  threatened  by  working  with  a  dog.   On  top  of  this 
there  are  real  or  imagined  limitations  imposed  by  the  blind 
person's  occupation.   To  the  extent  that  the  guide  dog  does_ 
appear  to  be  eminently  useful,  the  restrictions  imposed  on  its 
wider  applicability  are  clearly  a  subject  for  research. 

Euman   guide:    The  oldest  and  steadiest  of  resources,  usu- 
ally completely  untrained  and  only  mentioned  as  an  afterthought 
by  writers  on  the  topic  of  blind  mobility.   As  far  as  I  know 
there  is  as  yet  no  programme  for  training  the  relatives  of ^ 
blind  persons  either  generally  or  specifically — that  is,  either 
for  their  role  in  rehabilitation  as   such  or  in  mobility.   On 
the  other  hand  there  is  only  a  little  training  given  to  blind 
persons  concerning  their  relationship  with  the  sighted.   We 
know  the  problems  and  we  know  some  of  the  techniques  that  can 
be  taught:  for  example,  the  human  guide,  particularly  when  a 
member  of  the  family,  tends  to  be  over-protective  (and  quite 
naturally  so) ;  and  there  is  a  right  method  for  guiding  a  blind 
person.   There  is  the  other  problem  of  obtaining  sighted  help 
when  required  as  well  as  detaching  oneself  from  it  when  it  is 
no  longer  required.   Provision  for  training  of  the  human  guide 
is  clearly  indicated  in  future  training  schemes.   All  I  have 
said  here  about  the  human  guide  refers  to  formal  programmes. 
Home  Teachers  have,  of  course,  coped  with  these  problems  effec- 
tively for  many  years  and  we  should  be  able  to  benefit  from 
their  accumulated  experience  in  this  as  in  other  fields. 

This,  then,  concludes  the  part  dealing  with  resources 
generally  available  and  we  now  turn  to  the  last  group,  those 
in  various  phases  of  experimental  development. 

Experimental  Aids  (iii) 

Narrow    beam   ultrasonic    aid:    This  is  essentially  a  small, 
portable  form  of  sonar  with  an  auditory  output  to  the  blind 
person.   It  provides,  over  a  range  of  some  20  feet,  the  very 
rough  equivalent  of  a  very  narrow  tunnel  vision.   It  emits  a 
signal  and  when  this  strikes  an  object  an  echo  is  returned. 
The  properties  of  this  echo  carry  a  great  deal  of  information 
about  the  distance  and  nature  of  the  object.   By  adopting  an 
appropriate  scanning  pattern  and  putting  together  the  informa- 
tion gathered  successfully  it  is  possible  to  build  up  a  fairly 


12 


detailed  "picture"  of  the  environment  from  the  information  pro- 
duced by  the  aid.   The  problem  arises  when  aid  and  information 
have  to  be  handled  by  a  human  being  who  cannot  see.   I  have 
gone  into  some  detail  over  this  at  a  Southern  Regional  Associa- 
tion Conference  (S.R.A.B.  Conference  Report  No.  53  Ed.),  and 
nothing  which  has  happened  so  far  has  made  me  change  my  basic 
point  of  view  on  the  matter:  there  is  a  place  for  such  a  device 
in  our  armoury  since  it  is  the  only  device  which  can  help  the 
blind  person  to  perceive  at  a  distance  in  some  detail.   To  the 
extent  that  such  distance  perception  can  be  learned  and  uti- 
lised it  is  clearly  desirable.   At  present  my  guess  is  that 
the  device  will  be  found  to  help  as  a  navigational  aid  to  as- 
sist in  straight  line  travel  (by  obtaining  a  fix  on  a  known 
landmark  such  as  a  beacon  the  other  side  of  a  crossing) ,  and 
in  the  recognition  of  certain  landmarks  at  a  distance. 

There  are  extensive  evaluations  of  the  device  being  car- 
ried out  at  present  all  over  the  world.   The  results  of  these 
evaluations  will  be  presented  to  an  international  conference 
early  this  summer. 

Other  electronic  aids  have  not  reached  the  production 
line  as  yet.   Of  these,  the  most  interesting  is  one  which,  de- 
signed by  Mr.  Lindsay  Russell,  emits  a  broad  beam  ensuring 
coverage  for  the  whole  of  the  upper  part  of  the  body,  and  dis- 
playing simple  information  about  the  presence  or  absence  of 
obstacles  in  four  zones  of  increasing  proximity  to  the  body. 
This  device  therefore  should  enable  the  blind  person  to  know 
the  extent  to  which  the  forward  path  is  clear,  leaving  the 
finer  detail  to  other  resources. 

The  great  attractiveness  of  electronic  aids  to  the  blind 
is  their  lack  of  conspicuousness  and/or  their  having  a  positive 
status  symbol.   To  the  more  theoretically  minded  their  attrac- 
tiveness lies  in  the  possibility  of  providing  early  warning  and 
a  very  partial  substitute  for  distance  receptors.   The  drawback 
lies  in  the  simple  fact  that  the  information  processing  is 
eminently  complex  and  does  not  utilise  as  direct  a  system  as 
do  other  aids. 

Radio-compass :    In  the  absence  of  vision  it  is  difficult 
to  maintain  a  straight  course,  and  even  more  difficult  to  no- 
tice when  one  has  departed  from  a  straight  course.   Apart  from 
this  there  are  a  set  of  occasions  where  it  is  useful  to  have 
available  a  constant  reference  direction  when  moving  through 
unfamiliar  territory  (the  sighted  have  the  sun,  or  a  distant 
dominant  landmark  like  a  hill  or  a  tower  for  this) .   Active 
work  has  been  going  on  to  provide  the  blind  with  a  suitable 
aid.   So  far  it  appears  that  the  only  viable  device  is  Swail ' s 
radio  compass  which  relies  on  the  directionality  of  the  ferrite 
core  aerial  inside  an  ordinary  transistor  radio.   By  tuning  to 
a  known  station  it  is  possible  to  direct  the  set  so  that  one 
obtains  maximum  signal  strength,  and  this  in  turn  can  be  suit- 
ably displayed  to  a  blind  person  to  provide  a  "Null"  signal. 
There  are  still  many  problems  to  be  solved,  but  a  first  step 
has  been  taken  by  the  Sensory  Aids  Evaluation  and  Development 
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Center  under  John  Dupress  in  taking  the  set  out  of  the  hand  and 
strapping  it  to  the  chest,  thus  cutting  out  one  considerable 
source  of  error  due  to  variable  hand-positions. 

In  whatever  form  it  will  eventually  see  the  light  of  day, 
there  is  undoubtedly  a  need  for  a  simple  and  reliable  straight- 
line  indicator  for  all  kinds  of  blind  travellers. 

Maps :    The  idea  of  providing  blind  persons  with  simple, 
portable  maps  is  relatively  new.   I  have  written  about  this  in 
the  February  issue  of  the  New   Beacon,    and  we  are  continuing  to 
work  on  this .   Whether  we  are  going  to  plumb  for  verbal  or  spa- 
tial maps  one  thing  is  already  quite  clear:  there  is  a  need  for 
the  development  of  a  common  language  to  describe  commonly  ex- 
perienced mobility  situations,  so  that  at  the  very  simplest 
level  blind  people  can  describe  routes  to  each  other  and  can 
understand  the  descriptions  given  by  the  sighted.   To  the  ex- 
tent that  existing  systems  already  make  use  of  such  languages 
one  would  hope  that  they  can  be  embodied.   For  example,  the 
guide  dog  people  do  have  a  set  of  terms  with  which  to  describe 
and  specify  some  aspects  of  mobility,  and  these  terms  do  al- 
ready have  some  common  currency. 

The  point  about  maps,  the  technicalities  apart,  is  that 
they  are  yet  another  means  of  enabling  the  blind  person  to  be 
more  independent,  for  they  should  enable  blind  persons  to 
choose  their  own  routes,  and  to  pursue  them  without  the  inter- 
vention of  the  sighted,  or  with  minimal  intervention. 

This,  then,  completes  the  resources  section,  ranging  from 
remaining  senses  through  existing  systems,  to  various  more  or 
less  experimental  aspects.   The  next  step  is  to  look  at  our 
Table  to  see  how  requirements  and  resources  are  matched. 

Using    the    table:    One  can  start  using  the  Table  either  by 
going  along  any  given  row,  or  by  going  along  any  given  column. 
There  is  no  need  to  go  through  every  item  here.   Instead  I 
shall  pick  a  few  examples. 

If  we  take  the  row  marked  Perception,  Distant,  we  can 
see  that  this  is  served  by  residual  vision  (if  this  is  present 
at  an  adequate  level) ,  to  some  extent  by  hearing,  by  a  guide 
dog,  a  human  guide,  and  by  a  narrow  beam  aid.   It  is  not  served 
by  touch,  or  either  of  the  canes.   Thus  a  totally  blind  person 
has  only  got  hearing  to  obtain  some  distant  perception.   If  we 
want  to  provide  him  with  additional  resources  we  have  to  look 
to  a  dog,  a  human,  or  a  narrow  beam  device.   If  for  some  rea- 
son he  is  not  suitable  for  guide  dog  working,  there  is  only 
the  human  or  the  narrow  beam. 

Take  the  row  marked  Obstacles  Detection,  Feet.   This  can 
be  achieved  by  residual  vision,  by  touch  if  one  walks  slowly 
enough  or  is  prepared  to  accept  the  odd  injury,  by  a  long  cane, 
dog,  human,  and  narrow  beam  marginally  only:  it  has  to  point 
in  the  right  direction  and  any  drop  of  the  terrain  is  hard  to 
discriminate  in  sufficient  time  to  stop  oneself  even  at  moder- 
ate speed.   At  foot  level,  neither  hearing  nor  a  short  cane 
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are  of  much  use  when  walking  even  moderately  slowly.   if  there 
is  no  residual  vision  there  is  really  nothing  among  the  remain- 
ing senses  that  can  assure  the  blind  traveller  of  safe  progress 
with  regard  to  obstacles  at  foot  level  if  he  wants  to  walk  at  any 
reasonable  speed.   He  does  need  some  form  of  aid:  the  long  cane, 
dog  or  human  guide.   For  those  who  do  not  want  a  dog  or  human 
guide,  safe  travel  in  this  respect  can  be  obtained  only  by  use 
of  a  long  cane. 

Another  example.  Routes:  as  defined  earlier,  routes  as 
such  have  to  be  either  memorised  or  put  on  a  map.   This  also 
applies  to  the  guides.   Unless  we  have  got  maps  the  blind  trav- 
eller has  to  rely  on  memory  or  a  guide. 

Let  us  look  at  it  the  other  way  round  and  take  the  column 
headed  Long  Cane:  it  is  of  no  use  for  distant  perception,  for 
obstacle  detection  at  head  level,  for  routes,  for  the  detection 
of  slope,  distance  travelled,  or  time  elapsed.   But  it  is  emi- 
nently useful  for  obstacles  at  body  and  foot  level,  for  all  speeds 
of  travel  if  one  can  deal  with  obstacles  at  head  level  by  hearing, 
for  the  detection  of  curvature — possibly  also  for  veer  and  land- 
marks. 

It  will  already  have  become  obvious  from  these  examples 
that  one  gets  most  out  of  using  such  a  Table  by  looking  at  the 
configuration  of  yesses  and  noes,  by  taking  various  rows  and 
columns  in  combination.   This  works  in  two  ways:  on  the  one  hand 
one  says  for  instance,  given  no  residual  vision  and  the  require- 
ment to  move  at  the  same  speed  as  other  pedestrians,  what  is  the 
minimum  needed  by  way  of  aids?   On  the  other  hand  one  can  also 
find  out  how  many  requirements  can  be  served  by  a  multiplicity  of 
resources.   It  has  already  been  pointed  out  that  one  makes  use  of 
multiple  inputs  in  everyday  perception  to  facilitate  the  process 
and  because  there  is  always  the  chance  that  one  input  may  be 
temporarily  inactive  at  a  critical  moment:  if  you  can  hear  and 
see  a  car  approach  you  while  on  a  crossing,  a  sudden  loud  noise 
from  somewhere  nearby  does  not  put  you  out  of  action;  if  you 
have  a  long  cane  to  sense  the  ground  ahead  of  you  the  fact  that 
an  imminent  cloudburst  stops  you  from  using  your  residual  central 
vision  need  not  stop  you  in  your  tracks. 

Consider  another  use  of  the  requirements  resources  Table: 
blind  persons  having  too  much  residual  vision  are  not  held  to  be 
suitable  for  guide  dog  work.   Thus  there  is  always  likely  to  be 
a  group  of  blind  people  whose  residual  vision  is  not  sufficiently 
great  to  allow  them  to  move  about  entirely  unaided,  but  too  much 
to  be  considered  for  guide  dog  work.   Numerically  they  could  be 
about  a  third  of  the  registered  working  population,  say  10,000, 
and  at  least  a  similar  number  in  the  higher  age-groups  still  suf- 
ficiently active  to  want  to  move  about. 

When  one  comes  to  using  the  requirements  resources  Table 
together  with  the  Mobility  Competence  Scale  in  Appendix  B,  one 
does  so  in  order  to  rule  out  certain  possibilities.   Say  that  a 
blind  person  comes  under  heading  12;  travels  in  familiar  environ- 
ment with  a  cane,  does  not  travel  in  unfamiliar  environment. 
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The  first  thing  you  may  want  to  know  is  whether  he  could  be  ex- 
pected to  move  through  unfamiliar  environment  on  purely  tech- 
nical grounds;  is  his  mind  alert,  is  his  hearing  all  right,  is 
his  cane  technique  suitable?   Say  the  answer  to  all  these  is 
yes,  you  then  have  much  better  grounds  for  dealing  with  the 
person  at  the  next  level  of  complexity,  for  example,  there  may 
be  a  lack  of  interest  or  some  emotional  involvement.   This  is 
the  same  drill  which  doctors  follow  when  they  set  about  carry- 
ing out  a  diagnosis:  if  somebody  complains  of  being  tired  and 
out  of  condition  it  helps  to  know  whether  or  not  he  is  basically 
physically  fit. 

Checklists,  tables,  and  rating  scales  by  themselves  are 
nothing.   They  are  tools  which  have  to  be  used  with  sympathy 
and  intelligence.   But  used  thus,  they  can  save  time  and  assist 
the  user  in  arriving  at  a  helpful  solution.   From  the  point  of 
view  of  the  research  work  of  course,  the  requirements  resources 
Table  is  the  essential  jumping-off  ground  for  it  shows  us  the 
gaps  to  be  filled:  for  instance,  up  to  some  two  or  three  years 
ago  the  most  serious  problem  appeared  to  be  the  obstacles  at 
foot  level,  and  particularly  the  step  down,  the  open  manhole. 
We  now  think  that  the  long  cane  should  be  able  to  deal  with 
this  better  than  anything  other  than  guides,  human  or  canine. 
So  the  next  big  obstacle  of  our  time  is  street  crossing--bad 
enough  for  the  sighted,  perhaps  not  an  immediate  challenge  for 
research  but  one  to  be  kept  in  mind  since  it  would  appear  to 
be  the  largest  single  cause  for  "lost  time"  on  travel  through 
familiar  territory. 

Or  consider  the  row  "Distance":  it  is  completely  blank 
and  waiting  to  be  filled  in. 

PART  III:  THINKING  ALOUD  ABOUT  THE  FUTURE 

Once  again  in  this  section  I  do  not  want  to  go  very  far 
in  speculations  about  possible  advances  in  mobility  aids  for 
the  blind,  but  rather  to  indulge  in  some  speculations  about  a 
future  which  could  already  be  in  our  grasp. 

On  the  aids  side,  though,  it  is  likely  that  we  shall  see 
an  extension  of  the  use  of  electronic  distance  receptors  and 
straight  line  travel  indicators  and  before  the  turn  of  the  cen- 
tury we  may  see  the  first  glimmer  of  spare  part  surgery  in  the 
field  of  blindness  beyond  the  present  state  of  the  art. 

On  the  side  of  immediate  research  my  guess  is  that  we 
are  moving  towards  the  possibilities  of  providing  quicker  and 
more  reliable  assessment  of  the  remaining  abilities  of  blind 
persons  so  that  you  will  be  in  a  better  position  to  make  recom- 
mendations for  suitable  courses  of  training.   Work  which  has 
been  done  in  various  parts  of  the  world  could  be  combined  to 
put  blind  persons  through  a  test  battery  to  assess  their  ability 
to  deal  with  a  range  of  important  aspects  of  mobility:  hearing, 
balancing,  veering,  slope  detection,  orientation,  and  so  on. 
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Let  me  say  again  that  here  as  in  all  other  areas  of  therapy- 
such  tests  are  to  be  thought  of  as  tools  providing  one  part  of 
the  relevant  information  on  the  basis  of  which  decisions  have 
to  be  reached . 

It  is  also  likely  that  within  a  few  years'  time,  we  may 
be  in  a  much  better  position  to  provide  evidence  on  the  basis 
of  which  different  kinds  of  mobility  training  can  be  suggested 
to  different  people,  and  by  then  we  ought  to  know  more  about 
the  stress  experienced  by  different  people  using  various  mo- 
bility methods  in  different  situations. 

On  the  side  of  orientation,  I  am  confident  that  progress 
can  be  made  towards  a  common  language  to  describe  routes  and  a 
common  simple  system  to  make  maps.   It  is  already  within  our 
grasp  to  go  much  further  on  the  purely  technical  side  by  provid- 
ing blind  people  continuously  with  a  kind  of  grid-reference  of 
their  current  position,  but  this  is  the  sort  of  solution  which 
may  be  far  too  complex  in  relation  to  the  possible  need.   Never- 
theless, it  is  useful  to  know  that  there  is  a  solution  in  prin- 
ciple . 

But  there  are  possibilities  of  quite  a  different  nature 
which  you  may  well  think  it  is  not  for  me  to  talk  about  at  all. 
Nevertheless,  I  want  to  do  some  thinking  aloud  about  the  pos- 
sibility of  making  concrete  some  of  the  things  mentioned  in 
Part  I. 

If  there  is  agreement  on  the  basic  aims,  and  if  it  is 
agreed  that  some  sort  of  new  attitude  is  needed  would  it  not 
be  possible  to  discuss  at  least  the  administrative  implica- 
tions? 

A  unified  approach  towards  mobility  would  presumably  re- 
quire some  degree  of  unification  of  the  training  and  rehabilita- 
tion processes.   In  other  words,  there  is  surely  a  case  for 
being  able  to  examine  a  blind  person,  to  assess  them  reason- 
ably objectively,  and  to  recommend  one  of  a  number  of  alterna- 
tive courses  of  mobility  training.   These  courses  would  pre- 
sumably have  to  be  provided  at  general  rehabilitation  centres — 
that  is,  in  a  wider  rehabilitation  setting.   Again,  would  it 
not  be  possible  to  have  mobility  training,  whatever  its  form, 
carried  out  systematically  and  progressively? 

By  this  I  mean  on  the  one  hand  a  continuous  process  as 
far  as  the  congenitally  blind  are  concerned  in  which  each  suc- 
cessive age  can  build  upon  the  earlier  knowledge  and  in  which 
mobility  is  a  fundamental  concept  from  nursery  to  university 
if  necessary.   On  the  other  hand,  could  there  not  be  an  orderly 
progression  beginning  as  soon  as  feasible  after  the  onset  of 
blindness,  being  sharpened  during  forms  of  "primary"  rehabilita- 
tion (for  example,  Torquay)  and  continued  during  vocational 
training  (for  example,  Letchworth) ,  and  maintained  once  the 
blind  person  returns  home? 

Now  in  all  this,  and  for  many  reasons,  I  can  see  the  pos- 
sible need  for  a  new  kind  of  specialist  in  welfare  work,  know- 
ing full  well  the  extent  to  which  such  a  notion  cuts  across 
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current  developments.   But  might  it  not  be  useful  to  have,  say, 
at  the  level  of  each  local  authority,  a  person  whose  sole  re- 
sponsibility would  be  the  mobility  of  blind  persons  in  that 
area?   You  think  that  such  a  person  would  not  have  enough  to 
do  even  if  it  were  possible  to  appoint  her?   This  specialist 
would  have  to  know  enough  about  all  existing  forms  of  mobility 
to  assist  in  initial  assessment,  to  carry  out  pre-training  or 
mobility  training  during  domiciliary  rehabilitation.   This 
specialist  would  look  after  the  blind  people  on  return  to  their 
homes,  help  them  to  become  familiar  with   their  working  routes, 
provide  running  maintenance,  so  to  speak,  on  mobility  tech- 
nique, help  in  making  maps,  and  so  on.   The  person  so  trained 
would  have  to  know,  for  instance,  enough  about  guide  dog  train- 
ing, to  know  when  to  call  in  one  of  their  after-care  officers 
on  demand.   It  would  also  be  within  this   person's  terms  of 
reference  to  facilitate  cooperation  between  the  blind  and  the 
sighted.   Finally,  and  perhaps  as  important  as  any  other,  it 
would  be  up  to  this  person  to  assist  blind  persons  wishing  to 
change  from  one  form  of  mobility  to  another:  it  is  a  common 
enough  experience  for  a  blind  person  to  be  able  to  get  about 
practically  unaided  until  he  gets  into  the  early  forties  when 
the  decline  in  sensory  efficiency  begins  to  make  itself  felt. 
Such  a  person  might  well  then  want  to  take  advantage  of  guide 
dog  training  for  instance.   But  the  main  point  is  that  one  is 
suggesting  here  to  have  somebody  available  at  the  local  level 
who  will  have  been  trained  in,  and  kept  in  touch  with,  all  ex- 
isting aids  to  mobility,  training,  aids,  guides,  and  to  be 
available  at  all  times  to  assist  blind  persons  in  that  sphere. 

It  is  much  too  early  now  to  consider  the  structure  of 
such  a  service,  whether  it  should  be  governmental  or  voluntary, 
or  any  other  administrative  details  as  long  as  one  remains 
aware  that  if  such  a  person  is  to  be  turned  into  flesh  and 
blood  he  has  to  become  part  of  the  existing  welfare  structure. 
It  seems  rather  more  important  to  start  a  debate  on  the  need 
for  the  kind  of  tasks  I  have  outlined  above  to  be  done,  and 
done  well,  at  the  local  level. 

Concluding  Remarks 

Let  me  conclude  then  by  reiterating  that  in  order  to 
move  towards  a  unified  approach  to  blind  mobility  it  may  be 
helpful  to  think  of  the  problems  in  terms  of  matching  require- 
ments with  resources,  to  produce  specifications  for  both  re- 
quirements and  resources,  to  modify  these  if  required  in  the 
course  of  time,  and  to  ensure  a  common  final  aim  of  the  maximum 
possible  degree  of  mobility  by  whatever  means  are  found  to  be 
suitable  for  the  blind  person  concerned. 
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Appendix  A 

Implementation    of  Eesearah 

Research  on  mobility  is  being  carried  in  this  country  as 
well  as  abroad.   Information  about  ongoing  research  is  dis- 
seminated primarily  by  IRIS.* 

As  far  as  this  country  is  concerned  the  Research  Committee 
of  the  College  of  Teachers  for  the  Blind  acts  as  a  clearing  house 
for  all  research  schemes  as  far  as  they  involve  blind  children. 
RNIB  and  St.  Dunstan's  have  their  own  programmes,  of  which  the 
latter 's  current  evaluation  of  the  Ultra  Aid  sponsored  by  them 
is  at  present  the  largest  exercise. 

There  are  a  number  of  smaller  research  projects  on  related 
topics  at  Keele  University  and  at  Newcastle,  and  there  are  always 
a  number  of  enthusiastic  individuals  devoting  much  time  and  ef- 
fort to  this  form  of  research. 

Last  year  the  Medical  Research  Council  made  a  five-year 
grant  to  the  Department  of  Psychology  at  Nottingham  University 
to  study  more  generally  problems  of  mobility  of  the  blind.   The 
following  sections  provide  a  brief  outline  of  the  extent  to 
which  this  project  is  trying  to  fulfil  the  four  roles  for  re- 
search listed  earlier. 

1.  The  results  of  the  nation-wide  survey  carried  out  under 
the  auspices  of  the  Ministry  of  Health  by  Social  Survey,  which 
should  become  available  this  summer,  should  provide  us  then  with 
a  first  broad  picture  of  the  pattern  of  mobility  among  the  blind 
population  of  England  and  Wales. 

2.  Existing  methods  of  aiding  mobility  in  this  country  and 
the  United  States  have  been  studied  to  some  extent.   One  result 

of  a  visit  to  the  United  States  in  the  Spring  of  1964  was  a  strong 
recommendation  to  RNIB  and  St.  Dunstan's  that  the  Long  Cane  should 
be  given  a  trial  in  this  country,  and  that  such  a  trial  should  in- 
clude the  provision  of  an  expert  instructor  from  the  United  States, 
The  results  of  these  trials  are  now  a  matter  of  public  record 
{St.    Dunstan's   Review,    October,  1965;  il/ew  Beaaon,    December,  1965). 
Close  contact  is  maintained  with  the  various  evaluation  exercises 
which  are  at  present  being  carried  out  with  Professor  Kay's  ultra- 
sonic aid  all  over  the  world.   An  extended  series  of  observations 
of  blind  people  using  no  aid,  short  canes,  and/or  guide  dogs, 
covering  familiar  and  unfamiliar  routes  has  been  started. 

3.  The  present  paper  represents  one  aspect  of  the  process 
of  disseminating  information  in  which  we  are  concerned. 

*    International    Research   and    Information    Service    for    the    Blind: 
Leslie    L.    Clark,    American    Foundation    for    the    Blind,    15    West    16th 
Street,    New    York    11.       British   users    contact   RNIB,    224-8    Great 
Portland   Street,    London,    W.l. 
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4.  Various  programmes   of  research  on  fundamental  prob- 
lems of  posture  and  of  response  to  artificial  as  well  as 
natural  signals. 

Appendix  B 

Wright's    Mobility    Rating   Soale 

The  object  of  this  scale  is  to  have  a  single  number  by 
which  to  specify  the  level  of  mobility  obtained  by  any  person. 
It  has  to  be  used  with  considerable  caution  and  is  presented 
here  as  an  example  rather  than  as  a  generally  accepted  standard, 
It  purports  to  rate  mobility  from  1-15,  from  completely  inde- 
pendent mobility  to  complete  lack  of  mobility.   In  doing  so 
the  authors  have  had  to  make  a  lot  of  assumptions  about  the 
relative  merits  of  canes  and  dogs  for  instance,  and  one  has 
to  bear  this  in  mind.   They  have  also  not  yet  incorporated 
anything  about  speed  of  travel  because  this  has  only  become 
an  explicit  criterion  fairly  recently.   But  if  you  accept  all 
this  for  a  moment  this  is  a  scale  of  degrees  of  independent 
mobility.   It  is  undoubtedly  a  useful  quick  way  of  describing 
and  comparing  different  blind  people. 

Mohility    Competenoy    Scale 

1.  travels  in  familiar  environments  with  no  assistance 
travels  in  unfamiliar  environments  with  no  assistance 

2.  travels  in  familiar  environments  with  no  assistance 
travels  in  unfamiliar  environments  with  a  cane 

3.  travels  in  familiar  environments  with  no  assistance 
travels  in  unfamiliar  environments  with  a  guide  dog 

4.  travels  in  familiar  environments  with  no  assistance 
travels  in  unfamiliar  environments  with  companion 

5.  travels  in  familiar  environments  with  a  cane 
travels  in  unfamiliar  environments  with  a  cane 

6.  travels  in  familiar  environments  with  a  cane 
travels  in  unfamiliar  environments  with  a  guide  dog 

7.  travels  in  familiar  environments  with  a  cane 
travels  in  unfamiliar  environments  with  a  companion 

8.  travels  in  familiar  environments  with  a  guide  dog 
travels  in  unfamiliar  environments  with  a  guide  dog 

9.  travels  in  familiar  environments  with  a  guide  dog 
travels  in  unfamiliar  environments  with  a  companion 

10.  travels  in  familiar  environments  with  a  companion 
travels  in  unfamiliar  environments  with  a  companion 
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11.  travels  in  familiar  environments  with  no  assistance 
does  not  travel  in  unfamiliar  environments 

12.  travels  in  familiar  environments  with  a  cane 
does  not  travel  in  unfamiliar  environments 

13.  travels  in  familiar  environments  with  a  guide  dog 
does  not  travel  in  unfamiliar  environments 

14 .  travels  in  familiar  environments  with  a  companion 
does  not  travel  in  unfamiliar  environments 

15.  does  not  travel  in  familiar  environments 
does  not  travel  in  unfamiliar  environments 
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DEVELOPMENT  AND  ANALYSIS  OF  SOME  TACTUAL  MEASURES 

OF  INTELLIGENCE  FOR  ADOLESCENT  AND 

ADULT  BLIND* 


Eoline  Christine  Cull 


The  purpose  of  this  project  was  to  make  some  contribution 
to  improved  psychometry  of  the  blind.   Measures  of  mental  abili- 
ties m  which  the  subject  would  respond  to  tactual  stimulation 
were  created  and  tried  out.   The  project  was  limited  to  the  de- 
velopment and  selection  of  measures  over  a  difficulty  level 
suitable  for  counseling  with  adolescent  and  adult  blind.   It 
was  beyond  the  scope  to  make  final  tests  of  predictive  validity 
or  to  secure  extensive  norming,  although  concurrent  validity 
with  other  tests  was  sought  on  small  samples. 

Ten  tests,  to  measure  ability  through  the  capacity  of  indi- 
viduals to  perceive  and  evaluate  information  received  through 
manual-tactual  channels,  were  developed  from  vinyl  floor  tile 
figures  pasted  on  cards  of  pressed  board.   The  aim  was  to  measure 
capacity  of  subjects  to  identify  similar  or  different  figures 
recognize  the  parts  of  a  whole  or  the  whole  from  its  parts,  dis- 
cern figures  in  rotated  or  inverted  positions,  traverse  a  maze, 
identify  similar  figures  across  space,  remember  a  figure  over 
time,  and  transpose  quarter-inch  cubes  from  one  box  to  another 
using  various  combinations  of  fingers.   Two  vocabulary  and  one 
space  relation  measure  were  selected  as  criterion  standards. 

Thirty  sighted  subjects  responded  to  all  items  visually 
and  tactually.   They  were  randomly  divided  into  two  groups,  one 
reacting  to  sight  first,  the  other  to  touch.   Mean  scores  for 
the  groups  were  higher  when  the  response  was  to  visual  stimula- 
tion.  Individual  differences  in  performance  were  obtained   The 
two  groups  were  not  significantly  different  in  performance 'when 
they  responded  to  the  same  types  of  stimulation,  but  the  differ- 
ences were  significant  when  visual  were  compared  with  tactual 
responses . 

•  u^  Thirty  legally  blind  subjects  reacted  to  the  same  items. 
Eight  of  these  had  sufficient  residual  vision  to  influence  per- 
formance and  were  placed  in  a  subgroup  for  study.   Performance 
by  groups  and  subgroups  of  the  blind  were  compared  with  tactual 
reactions  of  the  sighted  groups  and  subgroups.   Scores  of  the 
blind  with  residual  vision  tended  to  be  higher  than  those  of 
either  sighted  group  or  the  blind  with  no  usable  vision. 

* 

Thzs    summary    of   the    author's    doctoral    dissertation    was    pub- 
l%shed    by    the    University    of  Southern    California    Graduate    School 
in    1965. 
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Principal  component  factor  analyses  with  varimax  orthogonal 
rotations  were  performed.   A  general-verbal-educational  factor 
appeared  in  all  groups.   Age  as  a  correlated  variable  loaded  on 
this  factor  for  the  sighted  but  not  so  much  for  the  blind.   None 
of  the  tactual  measures  loaded  on  this  factor  for  any  group, 
showing  that  the  measures  appeared  to  sample  other  than  verbal- 
educational  ability.   Factor  organization  for  the  tactual  tests 
was  unclear  in  the  sighted  subjects,  the  findings  tending  to  be 
singlet  and  doublet  factors  not  easy  to  interpret,  except  that 
in  one  case  figural  memory  may  have  emerged.   For  the  blind  there 
appeared  to  be  two  interpretable  group  factors  on  the  tactual 
tests,  factors  which  may  be  tentatively  identified  as  discrimina- 
tion of  shapes  and  visualization  of  movement  of  figures  through 
space.   The  Space  test,  which  was  factorially  pure  in  its  prepara- 
tion, was  given  to  the  sighted  subjects.   It  tended  to  remain 
factorially  aloof  from  the  tactual  tests,  suggesting  independence 
of  visual  and  tactual  domains,  just  as  the  latter  seemed  fac- 
torially apart  from  the  verbal. 

Within  the  limitations  of  this  study  it  appears  that  tac- 
tual measures  can  be  employed  to  test  abilities  of  youths  and 
adults.   It  is  recommended  that  the  study  be  continued  so  as  to 
provide  more  information  about  the  factorial  nature  of  abilities 
in  the  blind,  secure  predictive  validities  of  the  measures  used, 
and  obtain  adequate  norms. 


24 


AN  INVESTIGATION  OF  HUMAN  VISUAL 
INFORMATION  TRANSMISSION* 


Ronald  Joseph  Massa 


ABSTRACT 

An  empirical  psychophysical  study  of  visual  infointiation 
transmission  is  described.   Attention  is  restricted  to  informa- 
tion transmission  in  "one  glance,"  as  measured  by  both  total 
report  (pattern  reproduction)  and  partial  report  (sampling) . 
Patterns  and  English  letter  arrays  from  a  large,  but  finite, 
two-dimensional  ensemble,  subtending  visual  solid  angles  up  to 
10°,  are  the  primary  information  sources.   Information  trans- 
mission rates  are  found  to  be  a  function  of  the  pattern  en- 
semble with  total  report  transmission  of  16  bits/exposure 
measured  from  10-element  patterns  and  9  bits/exposure  trans- 
mitted from  5-element  patterns.   The  role  of  short-term  visual 
memory  in  information  transmission  from  the  same  sources  is 
also  discussed.   A  sampling  technique  for  the  psychophysical 
measurement  of  short-term  memory  storage  and  decay  is  described. 
The  short-term  memory  is  shown  to  be  partially  eidetic  and 
capable  of  storing  at  least  2.5  times' the  information  avail- 
able in  total  report.   It  is  concluded  that  the  subjective 
classification  of  source  patterns  into  "random"  or  "structured" 
groups  provides  a  reliable  basis  for  predicting  performance  in 
both  total  report  and  short-term  memory  readout  experiments. 
Objective  eye  motion  measurements  indicate  that  the  subject' 
must  rely  on  a  single  fixation  point  for  exposures  shorter  than 
125  msec;  and  that  post-exposure  movement  is  a  function  of  the 
stimulus  presented  during  the  exposure.   The  role  of  dispersion 
and  containment  in  performance  is  demonstrated  and  it  is  con- 
cluded that  the  same  spacial  distribution  of  related  and  unre- 
lated items  results  in  considerably  different  performance. 

*Submitted    to    the    Department   of  Eleotvioal    Engineering    on 
August    21,    1961    in   partial    fulfillment    of   the    requirements 
for    the    degree    of   Doctor    of   Philosophy. 

This    work    was    supported   in   part    by    the    United   States   Army 
Sxgnal    Corps,    the   Air    Force    Office    of  Scientific   Research, 
and    the    Office    of  Baval   Research,    and    in   part    by    the    National 
Science    Foundation. 
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1.  INTRODUCTION 

Man's  interest  in  understanding  the  operation  of  his  own 
sensory  modalities,  especially  the  visual  modality,  need  not 
be  discussed  here.   Today,  as  all  phases  of  our  technology  ad- 
vance, we  wish  to  understand  sensory  modalities  so  we  may  emu- 
late their  operation,  either  to  replace  them  in  a  handicapped 
human  being,  or  to  develop  electronic  or  optical  equipment  that 
perform  functions  similar  to  human  sensory  functions.   This  in- 
terest in  sensory  operation  has  both  resulted  in  the  discovery 
of  many  new  animal  sensory  functions  and  contributed  to  our 
understanding  of  the  obvious  ones. 

Through  the  years  many  attempts  have  been  made  to  enhance 
our  knowledge  of  sensory  systems.   These  studies  may  be  broadly 
classified  into  two  groups.   One  is  predicated  on  the  fact  that 
the  major  interest  in  the  sensory  system  lies  in  its  in  formation - 
processing    role.   Investigators  concerned  with  this  approach 
find  it  necessary  to  observe  the  internal  activity  of  the  human 
being  or  animal  in  response  to  excitation  (usually  external  ex- 
citation) of  the  modality  in  question.   Most  such  experiments 
are  objective.   An  important  class  are  neurophysiological  ex- 
periments in  which  the  representation  of  various  visual  stimuli 
in  the  nervous  system  is  studied  at  the  level  of  individual 
fibers  or  fiber  bundles.   Investigations  of  this  nature — hundreds 
are  described  in  the  literature — while  they  have  not  given  us 
many  general  operational  or  organizational  principles  of  the 
visual  modality,  have  contributed  to  our  understanding  of  in- 
ternal response  to  various  sensory  stimuli,  and,  in  fact,  have 
determined  to  a  certain  extent  the  electrical  representations 
within  the  nervous  system  of  various  broad  classes  of  visual 
and  acoustic  stimuli  (1,  2,  3). 

The  second  approach  is  behavioral  or  psychophysical.   These 
studies  are  predicated  on  the  fact  that  the  human  being  acts _ as 
a  transmitter  of  information.   The  simple  block  diagram  in  Fig- 
ure 1.1  represents  the  human  being  merely  as  a  "black-box"  proces- 
sor of  sensory  information.   The  human  behaves  or  acts  in  response 
to  visual  stimuli.   In  many  such  experiments  the  subject  is  told 
how  to  act  in  response  to  various  sensory  stimuli,  and  inferences 
about  his  information-processing  activities  within  any  given 
sensory  modality  are  made  on  the  basis  of  how  well  he  responds 
in  the  required  manner  to  various  external  stimulus  inputs. 

The  fundamental  distinction  between  psychophysical  and 
substantive  information-processing  experiments  is  that  in  the 
former  the  subject  nearly  always  responds  through  a  second 
modality.   Thus,  information-transmission  experiments  involve 
two  modalities — the  stimulated  modality  and  the  response  mo- 
dality.  It  is  very  difficult  to  draw  inferences  from  psycho- 
physical experiments  about  the  processing  of  visual  information 
at  the  level  of  the  retina,  optic  nerve,  or  cortex.   Furthermore, 
experimental  artifacts  introduced  by  the  response  modality, 
which  are  difficult  to  assess,  often  act  as  the  ultimate  per- 
formance-limiting factors. 
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Several  objective  neurophysiological  experiments  have  ex- 
amined visual  information  processing  in  the  retina  (4,  5),  optic 
nerve  (6,  7),  lower  brain  centers  (8),  and  cortex  [(9,  10);  mostly 
in  lower  animals] ,  without  the  manifestation  of  serious  response 
modality  artifacts.   The  relation  between  the  results  of  these 
experiments  and  psychophysical  experiments  involved  with  gross 
infoirmation  transmission  is  not  well  understood. 

This  thesis  describes  a  direct,  empirical  study  of  human 
visual  information  transmission  in  very  specific  tasks.   It  seeks 
to  define  performance  characteristics,  organizational  principles 
(valid  at  least  for  the  small  class  of  stimuli  considered) ,  and 
system  aspects  of  the  visual  process  that  influence  man's  ability 
to  process  or  act  in  response  to  certain  visual  information 
sources. 

Similar  investigations  have  been  undertaken,  including 
studies  of  the  psychophysical  response  to  acoustic  stimulus 
(2,  11)  and  of  tactile-kinesthetic  senses  (12,  13,  14,  15,  16). 
In  each  instance  the  desired  experimental  output  may  be  expressed 
in  terms  of  some  quantitative  measure  of  the  human's  ability  to 
transmit  information  initially  received  through  the  auditory  or 
tactile-kinesthetic  senses.   One  particularly  difficult  problem 
in  such  experimentation  is  the  quantitative  measure  of  perform- 
ance.  Recent  developments  in  information  theory,  beginning  with 
Shannon's  work,  initially  appeared  to  be  very  promising  for 
extrapolation  to  psychophysical  or  psychological  experimentation. 
Unfortunately  the  promise  has  proved  superficial.   It  is  often 
very  difficult  to  assess  information  content  of  a  stimulus  or 
information  transmission  by  a  subject  in  terms  of  such  well- 
defined  quantities  as  bits  per  second. 

In  the  course  of  this  investigation,  information-theoretic 
concepts  are  used  where  they  appear  to  have  a  particularly  inter- 
esting relationship  to  the  experimental  task  or  where  they  are 
required  to  relate  results  to  other  studies.   These  concepts  and 
the  calculations  required  to  illustrate  them  are  considered  in 
Appendix  D. 

Much  of  the  attractiveness  of  such  concepts  in  psychophysi- 
cal experimentation  lies  in  the  fact  that  the  concepts  of  channel 
capacity  information  rates,  and  so  forth,  lend  themselves  very 
nicely  to  making  quantitative  models  of  various  sensory  proces- 
ses.  However,  the  question  of  model  making  in  human  or  animal 
sensory  processes  is  extremely  complicated.   First,  an  immense 
number  of  variables  must  logically  be  constrained  or  taken  into 
consideration  in  derivation  of  any  model.   The  role  of  many  of 
these  variables,  while  qualitatively  obvious,  is  quantitatively 
unresolved. 

Similarities  between  the  visual  sensory  modality  and  the 
mathematical  and  physical  channels  treated  in  the  study  of  in- 
formation theory  are  in  most  cases  obvious.   The  most  striking 
similarity  is  in  the  qualitative  operation  of  the  visual  channel. 
The  human  is  capable  of  receiving  and  operating  upon  sensory 
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information  of  increasing  complexity  with  small  increases  in 
error  rate.   Ultimately  a  complete  deterioration  of  performance 
occurs,  and,  in  fact,  the  information  transmitted  and  correctly 
acted  upon  decreases  as  the  input  rate  exceeds  some  threshold 
value  (17) .   This  threshold  value  is  often  regarded  as  a  form 
of  "channel  capacity"  for  the  system. 

In  addition  to  the  obvious  similarities  between  the  human 
visual  channel  and  transmission  channels,  there  are  significant 
differences  which  have  precluded  the  straightforward  applica- 
tion of  theory  to  the  analysis  of  the  visual  system.   The  big- 
gest difference  is  that  most  interesting  measures  of  system 
performance  (for  example,  perception)  are  subjective  and  thus 
do  not  lend  themselves  to  precise  mathematical  representation. 
Furthermore,  the  capacity  of  a  human  sensory  channel  is  a  func- 
tion of  so  many  variables  that  mathematical  models  have  decidedly 
limited  application  at  the  present  time.   With  these  facts  in 
mind,  we  are  forced  to  conclude,  as  Quastler  does  (17),  that 
rigorous  methods  cannot  yet  be  employed  in  the  study  of  sensory 
operation  or  sensory  channel  capacity. 

At  least  one  worker — Jacobsen  (18,  19) — however,  has  ap- 
plied formal  methods  to  the  study  of  the  channel  capacity  of 
the  human  eye  and  ear.   He  has  selected  for  analysis  only  those 
portions  of  the  system  that  are  not  primarily  subjective--that 
is,  structure — and  the  resulting  bit  figures  are  more  properly 
considered  as  ultimate  capability  rather  than  operational  ca- 
pacity figures.* 

This  thesis  is  concerned  primarily  with  the  human's 
ability  to  extract  information  from  dispersed  visual  patterns, 
not  with  the  concept  of  visual  channel  capacity.   Thus  it  is 
focused  on  the  operational  features  and  the  size  of  patterns 
and  the  relationship  of  their  elements,  all  of  which  modify 
ability  to  extract  information  from  them.   The  experimentation 
is  psychophysical  in  nature,  except  for  a  few  experiments  in- 
tended to  illustrate  aspects  of  the  human  visual  system,  which 
one  might  class  as  "mechanical"  or  "system"  aspects.   Such 
things  as  the  size  of  the  pattern  and  its  role  in  perception, 
the  light-versus-time  sensitivity  of  the  human  eye,  and  the  speed 
with  which  the  human  eye  must  track  to  derive  information  are 
ordinarily  not  treated  in  psychophysical  pattern-recognition 
studies.   Therefore,  it  is  the  author's  hope  that  this  work 
represents  a  sensible  beginning  to  an  intermediary  study--that 
is,  one  somewhere  between  the  very  basic  bit  rate  figures  such 
as  have  been  derived  from  the  experiments  of  Miller,  Brunner, 
and  Postman  (20)  and  others  (21)  and  the  complex  normal  visual 

*Jaaobsen    estimates    a    bit    aaipaQity    of   4.3    x  lo      hits    for    the 
eye    and   about    5   percent   of    this    figure    for    the    ear. 
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situation  encountered  in  everyday  life,  where  we  must  contend 
with  an  infinite  pattern  ensemble,  colors,  the  gross  motion 
of  the  subject,  the  wide  range  of  dynamic  light  intensities, 
and  many  other  factors  whose  influence  must  be  understood  be- 
fore we  can  truly  have  a  feeling  for  the  operation  of  human 
vision. 
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2.     SOME  RELEVANT  ASPECTS  OF  HUMAN  VISUAL 
INFORMATION  TRANSMISSION 

In  this  section  a  framework  is  established  for  the  experi- 
ments that  follow.   Several  aspects  of  visual  communication  are 
recalled  from  the  literature,  and  some  ideas  pertinent  to  the 
problem  are  interjected  by  the  author. 

This  research  does  not  seek  to  solve  the  momentous  problems 
of  what  or  how  humans  see.   Rather,  it  approaches  a  single  and 
narrow  but  significant  problem  in  visual  communication,  which 
the  author  chooses  to  call  the  one-glance  problem — the  problem 
of  the  transmission  of  visual  information  gathered  through  a 
single  exposure  to  a  given  visual  stimulus. 
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2.1  The  One -Glance  Problem 

In  normal  visual  situations  the  human  receives  and  acts  upon 
visual  information  received  through  a  series  of  related  glances  at 
a  visual  field  extending  over  more  than  180  deg  in  the  horizontal 
direction  and  100  deg  in  the  vertical  direction.   Visual  acuity  is 
not  uniform  over  this  entire  field  for  all  positions  of  the  eyes. 
Presumably,  the  only  portion  of  the  visual  field  that  projects  on 
the  foveal  area  of  the  retina  is  portrayed  with  the  full  resolution 
capability  of  the  visual  system  (1) .   This  solid  angle  of  foveal 
vision  is  surprisingly  small.   While  accurate  figures  are  not  re- 
ported in  the  literature,  it  is  safe  to  assume  that  foveal  vision 
occurs  over  a  solid  angle  of  less  than  5  deg.   The  remaining  solid 
angle  of  vision  for  any  eye  position  is  called  the  peripheral  angle. 

It  is  particularly  convenient  for  our  purposes  to  define  the 
limits  of  the  one-glance  problem  independent  of  stimulus  duration 
or  spacial  extent — bearing  in  mind,  of  course,  that  any  such  defini- 
tion will  allow  both  temporal  and  spacial  effects  to  become  signifi- 
cant factors  of  performance.   We  define  the  one-glance  problem  as 
the  information-transmission  problem  characterized  by  a  single  ex- 
posure to  a  visual  stimulus,  with  report  by  the  subject  beginning 
after  the  stimulus  exposure  is  over.   To  avoid  undue  complications, 
the  one-frame  problem  is  restricted  to  stimuli  well  above  threshold 
intensity;  stimulus  duration  is  selected  in  accordance  with  the 
considerations  outlined  in  the  following  paragraph. 

We  can  state,  at  least  qualitatively,  that  in  visual  informa- 
tion-transmission tasks  performance  as  a  function  of  stimulus  dura- 
tion and  the  spacial  extent  of  the  information  source  is  as  shown 
in  Figure  2.1.   For  stimulus  intensity  {Sq)    well  above  the  stimulus 
intensity  threshold  (S'crit)  r    performance  will  ultimately  reach  zero 
as  the  duration  of  the  stimulus  approaches  zero.*   Details  of  per- 
formance in  various  tasks  during  this  intensity  integration  region 
are  reported  by  Hunter  and  Sigler  (2)  and  Hartline  (3) .   For  the 
intensities  used  throughout  this  research  the  lower  end  of  the  one- 
glance  region  is  at  an  exposure  of  less  than  10  msec  (^niin)  • 

In  Figure  2.1  the  longest  duration  of  the  one-glance  region  is 
about  3  sec  (^max) •  The  choice  of  T^^x  ^^  somewhat  arbitrary.  The 
figure  3  sec  is  chosen  for  three  reasons. 

1.  It  is  difficult  for  subjects  to  remain  fixated  for  longer 
than  3  sec  without  eye  blinking  and  head  motion. 

2.  It  is  difficult  to  prevent  a  partial  report  or  other  arti- 
ficial stimulus  encoding  for  durations  longer  than  3  sec. 

3.  In  most  information-transmission  tasks  the  subject  can 
gather  much  more  information  in  3  sec  than  he  can  "remember"  for 
reporting. # 

*This    is    the    only    situation    considered    here.       Stimulus    intensity^ 
was    not   a  variable ;    all    information    sources    were    -presented   at    light 
intensities   well    ahove    threshold   for   which   all    parts    of   the    stimulus 
could    be    clearly    seen    by    all    subjects    for   all    exposure    durations. 

iThis   point    is   discussed   at   greater    length    in    section    2.S. 
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In  the  region  of  interest  between  T^j_^   and  T^^^   perform- 
ance from  sources  with  the  same  information  content  is  critically 
dependent  upon  the  source  dispersion.   This  dependence  is  most 
readily  illustrated  in  the  extreme.   Projection  of  a  single 
l-in.-high  English  letter  (from  a  large  ensemble)  at  a  distance 
of  2  ft  for  a  duration  of  10  msec  would  result  in  recognition 
nearly  all  the  time  by  all  subjects.   The  same  letter  2  ft 
high  would  be  quite  difficult  to  recognize  in  such  a  short- 
duration  exposure.   Thus,  the  one-glance  problem  is  the  transient 
problem  of  information-transmission  for  short  exposures;  it  is 
temporally  bounded  by  energy  integration  and  span  of  memory  re- 
gions and  critically  dependent  upon  dispersion  of  the  informa- 
tion source  as  well  as  its  detailed  nature. 

An  interesting  class  of  experiments,  which  does  not  empha- 
size temporal  or  transient  aspects  of  the  recognition  problem, 
is  exemplified  by  Julesz'  work  (12).   Julesz  attempted  to  de- 
termine which  patterns  are  seen  and  which  are  not,  given  ex- 
tremely long  exposure  durations;  hence  his  are  steady-state, 
or  long-term,  visual  pattern  recognition  experiments.   A  quali- 
tative similarity  between  Julesz'  work  and  this  research  is 
discussed  in  section  3.4. 

Short-duration  information  transmission  from  arrays  of 
English  letters  is  treated  in  some  detail  by  Sperling  (4)  and 
by  Miller,  Brunner ,  and  Postman  (5) ,  among  others.   And  Klem- 
mer  (6) ,  Frick  (7) ,  Pollack  (8) ,  and  others  have  considered 
short-term  information  transmission  from  linear  arrays  and 
matrix  arrays.   In  general,  these  experiments  use  small-dimen- 
sion pattern  sources  projected  to  subtend  small  angles  of 
vision. 

A  9  X  12  matrix  is  used  in  this  examination  of  the  one- 
glance  problem.   This  ensemble  permits  much  greater  freedom 
in  choice  of  patterns  and  provides  for  separation  of  the  pat- 
tern-registration problem  from  the  pattern-recognition  problem. 
In  smaller  ensembles  the  external  boundaries  of  the  visual 
field  provide  artificial  clues  which  modify  the  problem  of 
pattern  recognition  significantly.   While  it  is  advantageous 
to  retain  these  boundaries  to  simplify  the  pattern-reproduction 
problem  by  the  subject,  the  size  of  the  ensemble  still  permits 
adequate  separation  of  registration  and  recognition  effects. 

Patterns  selected  by  filling  in  some  of  the  squares  from 
the  9  X  12  pattern  matrix  were  used  in  a  pattern-recognition 
experiment.  Two  types  of  patterns  were  chosen  by  filling  in 
either  five  or  ten  of  the  108  available  positions.  Patterns 
with  five  filled-in  squares  are  referred  to  as  (5) -patterns , 
and  so  forth.  The  number  of  filled-in  elements  (n)  was  se- 
lected to  provide  for  classes  of  patterns. 

1.  (5) -patterns  with  widely  dispersed,  nonsymmetrically 
placed  elements  which  appear  as  five  dots  in  a  large  matrix 
field. 
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2.  (5) -patterns  with  closely  spaced,  symmetric,  or  pat- 
terned elements  which  are  relatively  easy  to  reproduce. 

3.  (10) -patterns  that  appear  as  a  high  density  of  arbi- 
trary squares  close  enough  to  be  related  to  each  other,  but 
not  conveying  a  unity  of  construction. 

4.  (10) -patterns  formed  into  common  shapes  or  figures. 

Photographs  of  sample  (5)-  and  (10) -patterns  are  shown  in  Fig- 
ure 2.2  exactly  as  they  were  presented  to  the  subjects. 

Unfortunately,  the  grid  lines  must  be  projected  along  with 
the  pattern  for  experiments  in  which  subjects  are  required  to 
reproduce  the  stimulus.   The  absence  of  grid  lines  allows  the 
subject  too  much  "artistic  license"  in  making  his  report.   Size 
distortions  too  difficult  to  "grade"  result.   The  matrix  lines 
are  drawn  so  that  the  outer  border  is  the  dominant  feature, 
with  the  interior  lines  still  clearly  seen  on  exposure. 
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2 . 2  The  Effects  of  Pattern  Dispersion 

Unlike  most  experiments  for  short-duration  stimulus  presenta- 
tions, the  displays  used  in  this  thesis  generally  subtend  angles 
up  to' 10  deg.   Patterns  of  this  size  are  sufficiently  dispersed _ 
to  require  gross  eye  motion  for  perception.   This  freedom  in  stimu- 
lus choice  has  some  significant  effects  on  performance.   Some  of 
these  effects  are  illustrated  in  sections  3.3,  5.2,  and  5.3. 

Generally,  the  effects  of  pattern  dispersion  are  not  well 
known.   It  is  not  difficult  to  appreciate  the  qualitative  effects 
of  dispersion  in  the  one-glance  problem  (see  section  2.1).   How- 
ever, several  questions  arise.   Are  dispersion  effects  different 
in  the  horizontal  and  vertical  directions?   Is  there  a  spacial 
span  of  apprehension  (analog  of  the  number  of  items  that  can  be 
remembered  from  the  same  spacial  "point")  as  a  function  of  exposure 
time?   How  are  the  answers  to  these  questions  modified  by  the  pat- 
tern material? 

While  assessing  the  quantitative  effects  of  dispersion  is  not 
a  primary  objective  of  this  work,  some  data  regarding  objective 
measures  of  eye  motion  and  horizontal  and  vertical  dispersion  ef- 
fects are  included  in  sections  5.1  and  5.2  and  Appendix  C. 

2.3  Information -Transmission  Report  Techniques 

Once  subjects  have  been  exposed  to  visual  stimuli  with  scpme 
information  content,  how  does  one  require  them  to  report  the  in- 
formation perceived  during  the  exposure?   Nearly  all  psychophysical 
reports  involve  another  modality  which  introduces  report  arti- 
facts.*  Ignoring  report  difficulties  for  the  moment,  an  interest- 
ing limitation  occurs  in  information-transmission  experiments. 
Miller  has  eloquently  stated  that  the  span  of  immediate  memory — 
the  store  from  which  report  information  may  be  drawn — can  handle 
about  ten  "items"  at  the  most  (9,  10).   Thus  — regardless  of  the 
information  content  of  a  stimulus  in  bits,  which  actually  impinges 
upon  the  retina,  progresses  along  the  optic  nerve,  and  is  processed 
in  the  higher  brain  centers — only  a  certain  portion  of  this  in- 
formation can  be  reported:  the  information  the  subject  can  encode 
into  about  five  to  ten  "items."   This  limitation  is  not  as  severe 
as  it  sounds.   The  redundancy,  or  information  shared  among  the  ele- 
ments of  a  visual  stimulus,  can  be  expressed  in  terms  of  our  abil-  j 
ity  to  encode  the  stimuli  into  some  fixed  number  of  items  after 
relatively  long  exposures. 

Averbach  and  Sperling  have  shown  that  this  span  of  immediate 
memory*  limitation  holds  only  for  total  report—that  is,  reporting 

*An    example    of  a    vepovt    artifact    which    is    an    exipeviment    limitation 
of   significance    is    discussed    in    section    5.S. 

^The    term    "span    of   immediate   memory"   is    somewhat   misleading .       Im- 
mediate  memory    has    heen   demonstrated    to    decay    very    slowly    (ll)^^ 
remaining    essentially    unchanged   for   minutes    or    hours    in    some    in- 
stances. 
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everything  in  the  stimulus  or  reproducing  the  stimulus  (11) . 
They  describe  a  technique  for  measuring  information  available 
earlier  in  the  information-processing  chain,  perhaps  in  the 
retina  itself.   In  general,  they  conclude  that  "...  the 
visual  process  involves  a  buffer  storage  of  relatively  high 
capacity  that  can  take  in  information  virtually  instantaneously 
and  retain  it  to  permit  its  relatively  slow  utilization." 
They  estimate  storage  capacity  of  this  buffer  at  greater  than 
or  equal  to  70  bits,  with  storage  decay  from  1/4  to  several 
seconds . 

Both  techniques — total  report  and  short-term  memory 
sampling — are  used  in  this  research  to  assess  pattern-recogni- 
tion principles  for  the  ensemble  described  earlier.   The  re- 
sults differ  significantly,  supporting  the  conclusion  that 
short-term  memory  stimulus  processing  is  conducive  to  higher 
information  transmission.   In  fact,  the  interaction  of  high- 
capacity  short-term  memory  between  related  glances  is  probably 
a  very  fruitful  area  for  research  aimed  at  understanding  the 
human's  apparent  high  information-processing  capability  in 
normal  perceptual  situations. 

Total  report  is  implemented  in  several  experiments  de- 
scribed later  by  requiring  the  subject  to  reproduce  exposed 
patterns  in  a  similar  field.   A  sampling  technique  for  esti- 
mating pattern  perception  in  the  short-term  memory  is  described 
in  section  4.2.   The  relation  between  span  of  immediate  memory 
for  independent  items  from  a  visual  stimulus  to  related  pat- 
tern elements  is  described  in  section  3.5. 

2.4    Experimental  Technique 

A  technique  for  the  presentation  of  short-duration  visual 
stimuli  using  an  ordinary  8  mm  motion  picture  film  has  been 
developed  and  used  for  many  of  the  experiments  reported  later. 
Because  the  mechanism  of  projection  results  in  an  intensity- 
versus-time  characteristic  significantly  different  from  that 
of  a  projection  tachistoscope ,  some  remarks  regarding  this 
technique  are  in  order. 

A  typical  short-duration  pattern  presentation  employed 
with  a  motion  picture  projection  technique  is  shown  in  Figure 
2.3.   The  subject  is  called  to  attention  by  a  2-sec  dark  in- 
terval on  the  screen.   Following  the  dark  interval,  a  flat 
white,  or  background,  sequence  is  projected  for  2  sec;  then 
the  pattern  is  exposed  on  the  white  background  for  1,  2,  5,  10, 
or  more  frames.   Immediately  after  the  pattern  exposure,  the 
qhite  background  is  projected  for  8  to  10  sec;  during  this 
period  the  subject  makes  his  report,  generally  in  writing. 
The  light  reflected  from  the  screen  provides  ample  illiomination 
for  a  written  report. 

The  projection  technique  results  in  the  light-versus-time 
curve  shown  in  Figure  2.4.   This  curve  is  measured  (approxi- 
mately) with  a  photographic  light  meter  which  monitors  reflected 
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light  from  a  common  glass-beaded  screen.   A  Bell  and  Howell 
8  mm  LUMINA  1.2  projector  with  fl.2  Zoom  lens  was  used.   The 
room  light  level  was  about  15  db  below  peak  light  during  white 
background  frames,  and  the  dark  background  preceding  the  pat- 
tern, used  for  call  to  attention,  was  about  10  db  below  peak 
light  level.   The  small  decrease  in  level  during  a  pattern  ex- 
posure is  caused  by  blacking  by  the  pattern  elements. 

The  significant  difference  between  a  motion  picture  and 
tachistoscope  presentation  is  evident  in  the  single-frame  ex- 
pansion graph  at  the  top  of  Figure  2.4.   At  an  exposure  rate 
of  16  frames/sec,  the  projection  lamp  is  shuttered  at  48  cycles/ 
sec,  essentially  chopping  the  light  into  three  distinct  pulses. 
This  light  presentation  requires  at  least  a  duty  cycle  weight- 
ing factor  for  comparison  with  single  light  pulse  tachistoscopes 
at  the  same  light  intensity.   The  light-to-dark  ratio  within  a 
single  frame  varies  somewhat  with  the  projection  speed.   This 
has  been  measured  at  3.3:1  for  the  slowest  speed  setting  and 
3.5:1  for  the  fastest  speed  setting  with  the  Bell  and  Howell 
LUMINA  1.2  projector. 

The  light-time  characteristic  of  motion  picture  projection 
has  several  advantages  over  tachistoscope  projection.   Its  ma- 
jor disadvantages  are  that  time  quantizing  must  be  used  (in 
terms  of  frames  of  exposure)  and  that  exposures  below  60  msec 
are  generally  difficult  to  achieve  without  special  equipment. 
The  advantages  include  ease  of  experimentation,  the  possibility 
of  testing  several  subjects  at  once,  timing  ease  for  multiple- 
exposure  experiments,  and  ease  in  the  generation  of  a  wide 
variety  of  preexposure  and  postexposure  fields. 

The  question  of  preexposure  and  postexposure  fields  and 
the  generation  of  afterimages,  which  materially  change  the  ef- 
fective exposure  duration,  has  been  discussed  by  several  work- 
ers (11,  13,  14).   The  white  preexposure  and  postexposure  fields 
used  in  the  experiments  described  later  in  conjunction  with  mo- 
tion picture  presentations  appear  to  be  minimally  conducive  to 
afterimage  formation.*  (This  point  is  discussed  further  in  sec- 
tion 4.)   Furthermore,  manifestations  of  the  Broca-Sulzer  phe- 
nomena (15)  demonstrated  in  part  in  tachistoscope  experiments 
discussed  in  section  5,  are  not  apparent  with  the  motion  picture 
display. 

It  is,  of  course,  well  known  that  normal  flicker-fusion 
occurs  at  a  much  lower  frequenty  (16)  than  that  implied  at  a 
16-frame/sec  exposure  rate — the  rate  used  throughout  this  work. 
The  subject  cannot  distinguish  these  from  tachistoscope  presenta- 
tions. 
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This    should   certainly    he    the    case    hecause    afterimage    forma- 
tion   could    seriously    interfere    with   motion   picture    quality. 
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3.  PATTERN  RECOGNITION  IN  ONE  GLANCE— TOTAL  REPORT 

Results  of  pattern-recognition  experiments  requiring  total  report 
by  the  subject  are  presented  in  this  section.   Total  report,  or 
pattern  reproduction,  is  a  psychophysical  process  which  is  dif- 
ferent from  pattern  recognition  in  the  short-term  memory  (treated 
in  the  next  section) .   The  experiments  described  in  this  section 
involve  only  the  finite  pattern  ensemble  discussed  in  section 
2.2.   In  general,  the  results  are  presented  by  experiment;  gen- 
eralizations made  in  later  sections  of  this  chapter  are  supported 
on  the  basis  of  the  experimental  data.   To  point  out  contrasts 
implicit  in  the  relationship  between  pattern  elements,  some 
letter-report  data  from  spacially  distributed  arrays  involving 
total  report  are  also  presented.   A  compilation  of  experimental 
data  by  subject,  or  other  appropriate  delineation,  is  included 
in  Appendix  B. 

The  general  objective  of  this  section  is  to  illustrate  gen- 
eral organizational  techniques  employed  by  the  human  when  faced 
with  a  pattern-recognition  task  involving  total  report.   Esti- 
mates, where  applicable,  of  information  rates  (see  Appendix  D) 
are  in  general  agreement  with  published  figures  regarding  the 
maximum  visual  information  intake  in  other  tasks.   Some  general 
statements,  difficult  to  quantify,  but  typical  of  general  per- 
formance in  a  task  of  this  nature,  are  also  included. 

The  reader  should  recall  that  stimulus  intensity — that  is, 
light  level — is  not  a  parameter  in  any  of  the  experiments  de- 
scribed in  this  work.   Light  levels  used  are  substantially  above 
threshold  and  result  in  experimental  exposures  that  are  clearly 
seen  and  clearly  read  by  all  subjects. 

3. 1  Information  Sources 

The  basic  information  source  used  for  the  pattern-recogni- 
tion and  pattern-organization  experiments  is  the  9  x  12  pattern 
matrix  described  in  section  2.2.   Two  sets  of  patterns  have  been 
created  from  this  basic  matrix  ensemble.   One,  the  (5) -set,  has 
been  generated  by  filling  in  five  of  the  108  squares  with  clear 
black  coloring.   The  second,  the  (10) -set,  has  been  created  by 
filling  in  ten  such  matrix  elements.   Figure  3.1  depicts  the 
ten  (5) -patterns  (lettered  A  through  J)  and  the  ten  (10) -patterns 
(numbered  1  through  10)  used  for  the  basic  pattern-recognition 
experiments.   It  can  be  seen  that  these  patterns  vary  with  re- 
spect to  any  a   priori   notion  of  complexity  within  each  set.   For 
instance,  some  of  the  (10) -patterns  are  highly  structured  or 
formed,  while  others  appear  decidedly  random.   These  basic 
twenty  patterns  were  used  in  connection  with  short-time  motion 
picture  displays  as  the  basic  pattern-information  sources,  or 
spacially  distributed  arrays. 

This  set  of  patterns  provides  for  sufficient  flexibility  in 
separating  the  problem  of  pattern  recognition  (that  is,  observing 
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(7)   (8) 


9)  (10) 


Figure    3.1.       (5)-    and    (10) -Patterns  —  Sheet    C 

and  reporting  the  correct  relationship  between  the  elements 
themselves)  from  the  problem  of  pattern  registration  (that  is, 
the  correct  placement  of  the  pattern  elements  within  the  matrix 
ensemble) .   In  fact,  for  most  patterns  the  basic  pattern  can 
be  written  down  completely  correctly  with  considerable  registra- 
tion error.   Furthermore,  the  simple  black  and  white  patterns 
exposed  to  subjects  are  clearly  seen,  and,  despite  the  grid 
lines  which  are  always  present  during  exposure,  the  basic  pat- 
terning effect  (recognition)  is  the  main  psychophysical  report 
phenomenon.*   (Throughout  the  remainder  of  this  study  patterns 
are  referred  to  either  by  letter  or  by  number  as  in  Figure  3.1. 

3.2  Classification  Experiment 

In  connection  with  the  results  of  pattern-recognition  ex- 
periments for  total  report,  a  preliminary  experiment  was  con- 
ducted in  which  subjects  were  asked  to  classify  the  twenty  test 
patterns. 

*Figure    3.1    does    not    show    the   grid    lines    on    the    patterns .       This 
is   merely    for   convenience    in   portraying    the    figures.       For   all 
exposures    the   grid    lines    were    included,    with    the   maQor   dark 
heavy    line    approximately    1/8    in.    in    diameter   around   the    outer 
border   of   the   pattern   and    the   grid    lines    about    1/5    of   this    thick- 
ness   (see    Figure    2.2). 
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Experiment    1 

Twenty  subjects,  male  and  female  between  the  ages  of 
twenty  and  thirty,  were  individually  shown  all  twenty  test 
patterns.   The  patterns  were  arranged  on  a  table  in  alpha- 
betic and  numerical  order.   Subjects  were  given  the  follow- 
ing instructions:   "On  the  table  before  you  there  are  twenty 
sheets  of  paper.   The  ten  sheets  of  paper  on  the  left  are  let- 
tered A  through  J.   The  ten  sheets  of  paper  on  the  right  are 
numbered  1  through  10.   The  difference  between  the  lettered 
sheets  and  the  numbered  sheets  is  that  the  lettered  sheets 
all  contain  patterns  formed  by  filling  in  five  of  the  108 
little  squares  on  the  sheet  of  paper.   The  numbered  sheets, 
1  through  10,  all  contain  patterns  which  are  formed  by  fill- 
ing in  ten  of  the  108  squares  within  the  matrix  frame. 

What  I  would  like  you  to  do  is  to  write  the  letters  A 
through  J  down  the  left-hand  side  of  the  sheet  of  paper  you 
have  been  given  and  the  numbers  1  through  10  down  the  middle 
of  this  sheet  of  paper.   I  want  you  to  classify,  to  the  best 
of  your  ability,  each  and  every  pattern  into  one  of  two  class- 
es by  placing  the  letter  'R'  or  the  letter  'S'  next  to  the 
letter  or  number  that  describes  the  pattern.   I  want  you  to 
place  the  letter  'R'  next  to  the  pattern  number  or  letter  if 
you  feel  the  pattern  is  'random.'   Place  the  letter  'S'  next 
to  the  number  or  letter  of  the  pattern  if  you  feel  that  par- 
ticular pattern  is  'structured.'   I  offer  you  no  further 
definition  of  the  words  'random'  and  'structured'  other  than 
what  these  words  may  connote  through  their  everyday  meaning 
to  you.   One  other  additional  bit  of  information  to  enable 
you  to  make  your  classification  is  that  I  want  the   patterns 
classified  in  such  a  way  that  neither  set  is  empty — that  is, 
there  is  at  least  one  'random'  pattern  and  one  'structured' 
pattern  in  each  of  the  two  sets  of  ten  patterns.   Are  there 
any  questions?" 

The  subjects  were  then  left  in  the  room  alone  for  as 
long  as  they  desired  to  make  their  classification. 

Most  subjects  were  able  to  perform  Experiment  1  with 
little  or  no  difficulty;  on  the  average,  about  three  to  five 
minutes  were  required  to  complete  the  task.   Results  of  this 
classification  are  presented  in  Figure  3.2.   The  subjects  were 
more  certain  with  the  (10) -patterns — that  is,  more  of  them 
agreed  as  to  their  classification.   Most  subjects  reported 
that  it  was  difficult  to  classify  many  of  the  (5) -patterns ; 
indeed  none  of  these  patterns  was  classified  either  100  per- 
cent structured  or  100  percent  random. 

Many  subjects  indicated  different  criteria  for  judging 
"R"  or  "S."   Considering  the  different  techniques  or  criteria 
used  to  make  this  discrimination,  it  is  surprising  that  so 
many  subjects  agreed  on  so  many  of  the  patterns.   These 
structured-random  distinctions,  made  without  any  time 
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Figure    3.2.       Classification    of   Patterns--Experiment    1 

restriction  or  without  stringent  definition  of  the  basis  for 
classification,  are  closely  related  to  performance  in  later 
pattern-recognition  tasks  involving  the  time  domain — that  is, 
short-duration  exposures.   This  relationship  is  considered  sig- 
nificant. 

On  the  basis  of  the  results  of  Experiment  1,  we  can  group 
the  various  patterns  into  structured  and  random  sets.   The 
reader  should  refer  to  the  patterns  as  he  studies  the  results 
(Figure  3.2);  he  can  compare  his  with  the  subjects'  notions 
as  he  attempts  to  see  the  pattern  features  that  influenced  the 
classification. 
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Of  the  twenty  patterns,  only  four  [(10)  and  (6),  (B)  and 
(I)]  were  actually  chosen  from  a  random  number  table;  all  others 
were  constructed  by  the  experimenter.   Several  subjects  volun- 
teered the  information  that  (6)  was  very  difficult  to  classify 
because  eight  of  the  ten  elements  are  apparently  "connected" 
by  a  smooth  curve  which  starts  from  the  lower  left  element  and 
proceeds  upward. 

3.3   Pattern-Recognition  Experiment — Results 

In  connection  with  pattern  recognition  in  one  glance  with 
total  report,  the  following  comprehensive  pattern-recognition 
experiment  was  conducted. 

Experiment    2 

Seven  subjects,  five  male  and  two  female  between  the  ages 
of  twenty  and  thirty,  were  exposed  to  12  0  test  patterns  involv- 
ing each  of  the  twenty  patterns  in  Figure  3.1  at  exposure  dura- 
tions of  1,  2,  5,  10,  20,  and  50  frames  of  a  motion  picture 
film  projected  at  16  frames/sec.   Each  subject  was  approxi- 
mately 9  ft  from  the  screen  (viewing  a  pattern  on  the  screen 
which  subtended  an  angle  of  about  8.8  deg) .   The  subjects  were 
given  an  answer  sheet  on  which  120  matrices  (six  to  a  single 
8  1/2  in.  X  11  in.  sheet)  were  printed.   Each  matrix  was  num- 
bered.  Every  fifth  pattern  was  numbered  (in  order  to  provide 
some  reference  should  the  subject  miss  one  of  the  short-duration 
exposures).   The  subjects  were  instructed  to  mark  X's  in  those 
boxes  within  the  matrix  in  which  a  black  square  appeared  during 
each  of  the  short-duration  exposures.   The  exposure  sequence 
shown  in  Figure  3.3  was  used  throughout  the  experiment.   In 
general,  there  was  ample  time  for  the  subject  to  make  his  re- 
port.  The  experiment  was  conducted  in  one  session  with  a  five- 
minute  break  between  the  sixtieth  and  sixty-first  pattern  ex- 
posures.  The  session,  including  the  break,  lasted  approximately 
45  min. 

Several  practice  patterns  at  the  beginning  of  the  film 
were  exposed  and  several  patterns  within  the  film  were  redun- 
dant in  order  to  provide  some  measure  of  the  stability  of  out- 
put of  such  an  experiment.   The  subjects  found  the  task  diffi- 
cult.  The  major  difficulty  encountered  by  the  experimenter  was 
in  preventing  the  subject  from  making  a  partial  report  before 
the  long-duration  (5  0  frames-3  sec)  exposures  disappeared  from 
the  screen.   Subjects  were  instructed  to  try  their  best  to 
register  the  pattern;  guessing  was  discouraged.   Seldom  did 
they  respond  by  marking  in  more  squares  than  were  actually 
projected  for  any  given  pattern.   They  were  not  permitted  to 
see  the  pattern  ensemble  beforehand,  nor  were  they  told  that 
the  patterns  consisted  only  of  five  and  ten  filled-in  squares. 
Generally,  this  was  discovered  very  early  in  the  game.   Further- 
more, the  patterns,  arranged  in  a  random  order  with  respect  to 
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both  pattern  and  duration  of  exposure,  were  not  conducive  to 
learninq.   Although  it  is  quite  simple  for  the  average  sub3ect 
to  recognize  some  of  the  patterns  he  has  seen  before,  this 
factor  did  not  materially  improve  performance. 

Two  grading  techniques  were  employed  in  determining  the 
results  of  this  experiment.   The  experimenter  first  recorded 
"absolute  registration  data."   A  clear  plastic  overlay  with 
the  correct  squares  marked  was  placed  over  the  response  sheets 
and  the  number  of  coincidences—that  is,  the  number  of  times  a 
SQuare  was  correctly  registered— was  recorded.   This  figure  was 
called  the  absolute  registration  grade  for  the  pattern  exposure 
point.   For  the  (5) -patterns  the  grades  vary  from  0  to  5 ,  and 
for  the  (10) -patterns,  from  0  to  10. 

The  second  grading  technique  is  the  one  of  primary  inter- 
est in  deducing  pattern-recognition  characteristics  and  organiza- 
tion   It  was  an  arbitrary  "best-fit"  technique  devised  by  the 
author  to  provide  some  basis  for  separating  of  pattern-registra- 
tion and  pattern-recognition  effects.   This  technique  was  im- 
plemented in  the  following  manner.   The  plastic  overlay  was 
shifted  to  provide  the  maximum  coincidence  or  correlation  be- 
tween the  correct  pattern  and  the  subject's  response.   Correct 
registration  due  to  shift  was  employed  in  a  special  sense.   For 
example,  if  a  subject  had  three  squares  of  a  (5) -pattern  appro- 
priately registered  (such  as  the  example  shown  m  Figure  3.4) 
and  had  at  least  one  coordinate  of  either  of  the  remaining  two 
squares  with  respect  to  the  three  properly  registered  correct, 
he  was  given  credit  for  that  square.   Figure  3.4  illustrates 
the  typical  pattern  grade  with  the  correct  answer  and  subject 
response  delineated.   This  technique  for  best  match,  although 
completely  arbitrary,  provides  a  basis  for  separating  recogni- 
tion and  registration  effects.   Initially,  the  author  was 
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Figure    S.4.       Best-Fit    Grading    Example 

concerned  over  types  of  answer  distortions  other  than  those  cov- 
ered by  the  simple  definition  of  best-fit  grading.   For  instance, 
what  would  be  the  grading  procedure  employed  if  the  subject  had 
expanded  or  contracted  the  size  of  the  pattern  in  such  a  way 
that  the  technique  for  best-fit  was  not  applicable?   In  only 
about  thirty  of  the  84  0  pattern  responses  was  there  any  doubt 
as  to  what  grade  to  assign,  and  in  most  instances  doubt  involved 
only  one  square.   Furthermore,  the  experimenter  described  the 
rules  for  best-fit  grading  to  a  naive  assistant  and  several  grades 
were  determined  by  both  experimenter  and  assistant.   There  was 
complete  agreement  between  the  experimenter's  and  the  assistant's 
grading.   While  such  agreement  does  not  assure  aptness  of  the 
grading  technique,  it  does  attest  to  its  consistency,  an  impor- 
tant attribute. 

The  quantitative  results  of  Experiment  2  are  presented  in 
several  graphs.   Figures  3.5  and  3.6  plot  the  number  of  elements 
correctly  recorded,  in  the  best-fit  sense,  as  a  function  of  ex- 
posure duration.   Exposure  duration  is  indicated  in  terms  of 
number  of  frames  on  the  semilogarithmic  plot  convenient  for  the 
presentation  of  the  data.   Even  with  extremely  long  exposure, 
the  subjects  were  not  able,  on  the  average,  to  portray  completely 
any  of  the  twenty  patterns.   There  is  a  great  difference  between 
individual  patterns  in  the  (5)-  and  (10)-  sets.   The  results  in 
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Figures  3.5  and  3.6  are  averaged  for  each  pattern;  behavior 
from  subject  to  subject  is  not  materially  different  from  that 
indicated  by  the  average.* 

Absolute  registration  data  are  not  plotted  for  all  pat- 
terns.  However,  Figures  3.7,  3.8,  and  3.9  provide  a  comparison 
of  absolute  registration  and  best-fit  data  for  three  pairs  of 
(10)-  and  (5) -patterns.   The  reader  should  note  that  in  general 
the  absolute  registration  grade  (number  of  elements)  is  much 
lower  than  the  best-fit  grade.   These  three  figures  illustrate 
a  fundamental  point  in  the  subjects'  processing  organization. 
For  very  short  duration  exposures  (one  frame)  patterns  that  in 
Experiment  1  were  most  often  regarded  as  structured  have  the 
greatest  separation  between  the  absolute  registration  and  best- 
fit  curves.   Patterns  most  often  regarded  as  random  [(6)  and 
(10)]  have  the  same  asymptote  (for  short  durations)  for  both 
absolute  registration  and  best-fit  data.   This  general  charac- 
teristic is  noted  throughout.   It  is  not  an  unexpected  result. 
When  one  is  suddenly  exposed  to  a  very  highly  patterned  exposure, 
the  patterning  aspect  is  far  more  important  than  the  registra- 
tion of  the  individual  squares.   When  confronted  with  no  obvious 
pattern,  the  subject  appears  to  revert  to  a  technique  of  measur- 
ing the  coordinates  of  one  or  two  of  the  squares  (about  all  that 
can  be  managed  for  very  short  duration  exposures) .   Although 
the  results  have  not  been  plotted  for  other  patterns,  it  is 
generally  true  that  more  random  patterns  (according  to  the 
classification  in  Experiment  1)  have  the  smallest  separation 
between  absolute  registration  and  best-fit  asymptotes  for  short- 
duration  exposures. 

A  few  general  statements  can  be  derived  from  the  raw  data 
in  Figures  3.5  through  3.9. 

1.  Almost  all  subjects  reported  a  total  number  of  squares 
less  than  or  equal  to  the  number  presented. 

2 .  An  angle-shifting  phenomenon  was  noted  on  some  patterns 
with  two  squares  forming  a  line  to  the  left  reported  almost  in- 
variably for  short  exposures  as  forming  a  line  to  the  right. 

3.  In  general,  subjects  were  much  more  adept  at  reporting 
pattern  features  than  correct  placement  or  registration  elements 
within  the  matrix.   This  is  especially  evident  in  Figure  3.10. 

4.  The  long-duration  asymptote  varies  significantly  from 
pattern  to  pattern.   This  asymptote  is,  in  general,  highest  for 
structured  patterns,  lower  for  patterns  over  which  there  is 
some  question  (from  Experiment  1) ,  and  much  lower  for  random 
patterns.   These  three  asymptote  groupings  for  long  exposures 
are  based  on  the  results  of  Experiment  2. 

*If  the  reader  is  interested  in  verifying  this  -point,  he 
should  consult  the  raw  data  for  the  experiment  which  are 
compiled    in   Appendix   B. 
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(10) -Patterns  (5) -Patterns 

Asymptote  Patterns  Asymptote  Patterns 

>7.0      (1),  (7),  (8),  (9)       >3.5      (A),  (F)  ,  (G)  ,  (h)  ,  (J) 
5.0         (3),  (4),  (5)         >3.5        (B),  (D) ,  (C) ,  (E) 
3.0         (2),  (6),  (10) 

The  high  correlation  between  asymptote  and  random-structured 
grouping  in  Experiment  1  is  significant. 

The  raw  data,  which  were  averaged  over  subjects  and  plotted 
for  each  pattern,  show  significant  shape  differences  between  the 
individual  patterns.   But,  a  word  of  caution  is  in  order  here. 
The  axis  involves  only  five  squares  for  the  (5) -patterns  and  ten 
squares  for  the  (10) -patterns .   One  must  consider  the  variance 
of  each  of  the  experimentally  measured  points  to  determine  the 
degree  to  which  the  measured  shapes  of  the  individual  curves  are 
significant.   In  general,  the  variance  is  less  than  or  equal  to 
one  square  for  each  of  the  points  in  Figures  3.5  and  3.6.   In  a 
few  isolated  instances,  probably  because  of  imperfections  in  the 
actual  projected  pictures,  variance  reaches  as  high  as  1.5  squares. 
Averaging  over  the  seven  subjects  has  a  decided  "smoothing"  ef- 
fect, and  these  variance  figures  indicate  that  some  of  the  less 
significant  shape  variations  must  be  taken  "with  a  grain  of  salt." 
However,  the  gross  features  of  the  individual  patterns,  especially 
their  high-duration  and  low-duration  asymptotes  (at  these  points 
the  variances  are  significantly  smaller) ,  are  statistically  sig- 
nificant. 

Figure  3.8  involves  two  patterns,  (C)  and  (F) ,  which  are  in 
a  sense  similar.   Low-duration  and  high-duration  exposure  asymp- 
totes are  essentially  the  same  for  (C)  and  (F)  with  respect  to 
both  absolute  registration  and  best  match.   However,  the  shapes 
of  the  performance  curves  differ  appreciably  between  these  asymp- 
totes.  In  Experiment  1  (Figure  3.2),  (C)  was  classified  random 
by  60  percent  of  the  subjects,  and  (F)  was  considered  structured 
by  6  0  percent.   This  performance  difference  for  moderate  dura- 
tions is  strongly  related  to  the  results  of  the  classification 
experiment;  it  is  discussed  in  detail  in  section  3.4.   Many  pat- 
terns [(A),  (C) ,  (G) ,  (2),  (3),  (7),  (9),  (10)]  exhibit  a  sharp 
upward  slope  in  performance  between  twenty  and  fifty  frames. 
This  improvement  is  attributed  to  premature  response  (before  the 
pattern  exposure  is  over)  and  a  second  glance  and  report  by  the 
subject.   Although  an  attempt  was  made  to  discourage  it,  many 
instances  of  premature  response  were  observed.   This  point  demon- 
strates why  the  long-duration  limit  of  the  one-glance  region 
should  be  taken  at  3  sec  (50  frames) ,  and  the  performance  enhance- 
ment offered  by  a  second  related  glance. 

What  about  the  subjects'  training  level  and  experience? 
Subjects  were  selected  only  on  the  basis  of  their  availability. 
Several  practice  exposures  were  included  to  assure  that  they 
understood  the  experiment.   In  all  cases  the  author  served  as 
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a  subject  before  conducting  the  experiment  on  others.   There  was 
very  little  difference  between  his  performance  and  that  of  naive 
subjects.   Furthermore,  in  several  of  the  experiments  that  re- 
quired many  exposures,  performance  did  not  improve  materially 
with  time  for  any  subject.   The  same  behavior  was  noted  when  the 
experiments  were  repeated  with  selected  subjects.   Thus,  it  is 
concluded  that  significant  learning  or  practice  effects  are  not 
manifested  within  the  time  duration  of  a  given  experiment,  nor 
does  it  appear  that  significant  learning  takes  place  during 
practice  runs.   In  either  case,  wide  variation  between  subjects 
attributable  to  different  learning  rates  was  not  observed. 

3.4  Pattern-Recognition  Organization 

The  major  significance  of  Experiment  1  is  that  its  results 
provide  a  basis  for  examining  individual  pattern-recognition 
performance  (in  a  best-fit  sense)  in  terms  of  pattern  groupings. 
For  instance,  the  fact  that  patterns  (1) ,  (8) ,  and  (9)  were  re- 
garded as  structured  by  all  subjects  prompts  the  question,  "For 
these  pattern  groups,  what  common  features  have  the  best-fit 
grade  and  absolute  registration  grade  as  a  function  of  exposure 
duration?"   We  must  bear  in  mind,  of  course,  that  the  measured 
variance  in  these  experimental  points  precludes  exhaustive  ex- 
amination of  the  fine  structure  of  these  responses  (at  least  the 
average  responses).   However,  experimental  data  strongly  support 
the  following  summary  of  organizational  principles. 

Four  typical  best-fit  grade-versus-duration  curves  can  be 
observed  in  the  results  of  Experiment  2  (see  Figures  3.5  and  3.6). 
These  are  shown  in  Figure  3.11.   Performance  with  random  patterns 
increases  linearly  (on  semilog  graphs)  for  both  the  (5)-  and 
(10) -sets  with  no  marked  deviation  at  any  particular  exposure 
duration.   Structured  patterns,  on  the  other  hand,  are  generally 
characterized  by  an  interval  of  exposure  durations  during  which 
there  is  a  sharp  upward  increase  in  slope.   Outside  of  this  re- 
gion, structured  patterns  are  indistinguishable  from  random  pat- 
terns (except  for  level  of  performance).   Thus,  it  is  concluded 
that  the  major  distinction  between  structured  and  random  patterns, 
as  measured  by  Experiment  2 ,  is  the  perception  of  "unity"  which 
characterizes  the  structured  patterns.   Until  this  unity  is  per- 
ceived, there  is  little  increase  in  performance  with  duration; 
after  it  is  perceived,  there  is  again  little  increase  in  perform- 
ance because  the  pattern  details  exceed  the  span  of  immediate 
memory.   The  structured  (10) -pattern  elements  result  in  a  higher 
level  of  performance  for  short  duration  than  for  random  patterns 
or  for  structured  (5) -patterns  because  of  the  higher  spacial 
density  of  closely  related  elements.*   The  same  general  statements 

*Durations    of   one    frame    are    too    short    for    eye    motion    to    occur; 
thus,    element   density    in    local    regions    is    quite    important .       The 
effects   of   spacial    extent    and    eye   motion    are    discussed   further 
in    section    5. 
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also  hold  for  (5) -patterns .  Furthermore,  the  difference  in 
performance  between  random  and  structured  members  of  the  (10)- 
set  is  greater  than  in  the  (5)-set  (see  Figure  3.11).  This  is 
closely  related  to  the  results  of  Experiment  1,  which  indicate 
generally  greater  difficulty  in  the  distinction  between  random 
and  structured  in  the  (5) -set.  Spacial  density  of  elements  is 
also  lower  for  the  (5) -set.  The  asymptotes  in  Figure  3.11 
agree  closely  with  those  on  page  57. 

The  value  of  exposure  duration  for  which  the  structured 
patterns  begin  to  exhibit  sharp  upward  slope  depends  upon  the 
pattern.   For  some  patterns  it  apparently  occurs  before  the 
lower  duration  bound  on  the  one-glance  region  (one  frame) . 
The  performance  curves  for  patterns  (H)  and  (J)  (see  Figure 
3,6)  demonstrate  that  this  critical  duration  is  a  definite 
function  of  pattern  size,  with  larger  patterns  exhibiting  great- 
er latency.*  In  general,  the  rise  occurs  between  12  5  msec  and 
300  msec  (two  and  five  frames)  for  (5) -patterns ,  and  between 
125  msec  and  625  msec  (two  and  ten  frames)  for  (10) -patterns . # 

To  demonstrate  these  principles,  pattern  data  are  presented 
with  respect  to  random-structured  groupings  in  Figure  3.12  for 
(5) -patterns  and  Figure  3.14  for  (10) -patterns.   The  structured 
(5)-patterns  selected  are  (A)  (75  percent),  (F)  (60  percent), 
and  (G)  (85  percent) ;  all  exhibit  a  performance  increase  be- 
tween two  and  five  frames.   The  random  (5) -patterns  are  (B) 
(75  percent) ,  (C)  (60  percent) ,  and  (D)  (70  percent) .   Because 
the  shapes  and  asymptotes  of  these  curves  are  quite  similar, 
they  have  been  averaged  for  convenience.   Similarly,  in  Figure 
3.13  the  structured  set  of  (10) -patterns  [(1)  (100  percent), 
(7)  (80  percent),  and  (8)  (100  percent)]  was  selected;  the 
random  (10) -patterns  chosen  are  (2)  (100  percent),  (6)  (70  per- 
cent) ,  and  (10)  (95  percent) .   These  results  hold  for  all  struc- 
tured and  random  patterns  of  both  (5)-  and  (10) -sets,  which 
strongly  suggests  the  organization  of  response  illustrated  in 
Figure  3.11. 

Julesz  (1)  has  demonstrated  that  the  perception  of  form 
in  binocular  displays  that  appear  to  be  random  can  take  90  sec 
or  more;  until   this  time  the  pattern  appears  completely  ran- 
dom, t   If  subjects  were  asked  to  reproduce  these  patterns  after 
shorter  duration  exposures,  they  would  presumably  have  to  re- 
sort to  reporting  the  element  coordinates.   Once  the  essential 
unity  was  perceived,  one  would  expect  performance  to  rise  sharp- 
ly and  then  level  off  because  pattern  details  would  far  exceed 
span  of  memory.   The  results  of  Experiment  2  illustrate  this 
same  qualitative  behavior  at  much  shorter  times  largely  due  to 
the  much  smaller  matrix  ensemble  (two  orders  of  magnitude  in 
each  dimension) . 

*Patter'ns    (H)    and    (J)    essentially    differ    in    sizes    only ^     (J)    be- 
ing  a    smaller  J,    inverted   version    of    (H). 

#It    is    shown    in    section    5    that    voluntary    eye   motion   does    not    oo- 
eur   until   at    least    125   msec    after  the    onset    of   the    stimulus 
flash. 

fThis    effect   also    occurs    for   monocular   patterns . 
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3.  5  Letter  Report  from  a  Spacially  Distributed 
Array — Some  Contrasts 

We  have  examined  performance  in  a  pattern-recognition  ex- 
periment requiring  total  report  (pattern  reproduction)  and  have 
deduced  several  organizational  principles  for  performance  pre- 
diction.  In  dealing  with  pattern  sources,  we  are  generally 
unable  to  express  quantitatively  the  way  in  which  information 
is  shared  between  the  elements.   In  general,  however,  the  vari- 
ous elements  of  the  spacial  array  which  forms  the  pattern  are 
related.   In  this  section  an  experiment  involving  total  report 
from  unrelated  elements  in  a  spacial  array  is  discussed. 

Experiment    3 

Six  subjects  were  exposed  to  forty-two  test  patterns  for 
durations  of  1,  2,  5,  10,  20,  and  50  frames  of  a  motion  picture 
display.   The  timing  of  each  display  was  as  shown  in  Figure  3.3. 
The  stimulus  material  consisted  of  five  or  ten  English  letters 
arranged  within  the  9  x  12  matrix  in  the  element  positions  of 
the  patterns  (H) ,  (J),  (B) ,  (1),  (2),  (6),  and  (8).   Each  pat- 
tern was  exposed  six  times,  once  for  each  duration.   In  addition, 
several  practice  patterns  were  exposed.   The  patterns  were  ar- 
ranged in  a  random  order  both  with  respect  to  duration  and  spa- 
cial array  (patterns) .   The  letters  were  chosen  such  that  each 
was  equiprobable  (zero-gram  English) .   The  subjects  were  in- 
structed to  write  along  a  horizontal  line  as  many  of  these  let- 
ters from  each  exposure  as  possible  without  respect  to  position 
or  order  in  the  array.   Figure  3.14  illustrates  a  typical  stimu- 
lus for  the  (B) -array  and  (1) -array.   The  letter  arrays  were 
projected  to  subtend  angles  of  approximately  9  deg  to  the  sub- 
jects.  The  light  level  was  the  same  as  in  Experiment  2. 

Experiment    3A 

Three  of  the  six  subjects  were  tested  with  six  redundant 
exposures  of  pattern  material;  pattern  (J)  was  exposed  for  2 
and  20  frames,  (1)  for  5  and  50  frames,  and  (6)  exposed  for 
10  and  20  frames.   Exposures  were  mised  among  the  42  exposures 
of  Experiment  3.   The  six  patterns  in  Experiment  3A  contained 
different  letters  (chosen  at  random)  from  those  in  the  corres- 
ponding exposures  in  Experiment  3. 

Experiment  3A  was  designed  to  determine  the  extent  to  which 
the  results  of  Experiment  3  depended  upon  the  actual  letter 
combinations  in  the  spacial  array.   Figure  3.15  compares  the 
letter  report  from  the  same  spacial  array  for  different  letters. 
There  is  little  difference  between  individual  subjects  and  vir- 
tually no  difference  in  the  total  niomber  of  letters  reported 
by  the  three  subjects  together,  which  indicates  that  the  differ- 
ences between  letter  arrays  are  well  within  experimental  preci- 
sion. 
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The  average  number  of  letters  correctly  reported  for  the 
four-letter  patterns  [(B),  (H) ,  (J)]  and  ten-letter  patterns 
[(1),  (2),  (6),  (8)]  are  shown  in  Figure  3.16.   For  short  dura- 
tions (one  and  two  frames)  the  letter  report  is  virtually  inde- 
pendent of  the  number  of  letters  present.   The  two  curves  diverge 
by  about  one  letter  from  two-  to  twenty-frame  exposures,  indi- 
cating that  increasing  the  source  rate  does  not  increase  per- 
formance but,  in  fact,  results  in  poorer  performance.   The  higher 
source  rate  (ten  letters)  ultimately  results  in  an  average  of 
six  correct  letters  reported,  while  the  five-letter  patterns 
are  completely  reported  (virtually)  at  the  50-frame  exposures 
(3  sec) .   Almost  all  the  letters  reported  were  correctly  re- 
ported; about  2.5  percent  were  incorrect.   The  most  common  in- 
correct reports  involved  confusion  between  "U"  and  "V." 

The  major  difference  between  Experiments  3  and  3A  and  other 
short-duration-exposure  letter-report  experiments  is  the  uncer- 
tainty in  the  letter  positions  (and  number  of  letters) .   Miller, 
Brunner,  and  Postman  (2),  in  examining  total  report  from  eight-' 
letter  sequences  of  zero-order  English,  measured  results  which 
follow  the  five-letter  pattern  curve  from  Figure  3.16  remarkably 
well  from  one  to  ten  frames.   Sperling  (3),  on  the  other  hand, 
finds  that  subjects  can  report  4 . 5  to  6  letters  regardless  of 
exposure  durations  from  15  to  500  msec  from  3x3  letter  arrays. 
These  results  are  difficult  to  reconcile  at  this  point;  uncer- 
tainty in  letter  position  is  undoubtedly  significant  as  is  the 
size  difference  (angle  subtended)  in  the  patterns.   Generally, 
these  points  are  explored  in  greater  detail  in  section  5.1. 

To  consider  the  contrasts  between  letter  report  and  pattern 
recognition,  we  shall  examine  the  letter  report  results  for  the 
various  spacial  arrays  (patterns).   Figures  3.17  and  3.18  show 
the  letter  report  data  by  pattern.   The  long-duration  asymptote 
IS  independent  of  pattern,  with  about  six  letters  reported  from 
the  (10) -patterns  and  five  letters  from  the  (5 ) -patterns .   For 
short-duration  exposures  there  is  very  little  difference  between 
five-letter  and  ten-letter  presentations,  but  performance  begins 
to  improve  earlier  (two  frames)  for  the  (5) -patterns  than  the 
(lO)-patterns  (ten  frames).   This  effect,  which  is  related  to 
the  problem  of  context  and  eye  motion  discussed  in  section  5.4, 
accounts  for  the  poorer  average  performance  of  the  ten-letter 
displays  for  exposures  from  two  to  twenty  frames. 

Two  other  significant  facts  should  be  pointed  out  here. 
First,  the  span  of  memory  compression  offered  by  the  relation 
between  the  elements  of  a  pattern  as  opposed  to  the  array  of 
independent  English  letters  is  exemplified  by  comparison  of 
Figure  3.17  or  3.18  with  3.5  or  3.6.   Six  items  (when  the 
Items  are  English  letters)  can  be  reported  from  a  (10) -pattern 
array  after  a  long  exposure.   For  related  pattern  elements  the 
number  of  elements  varies  from  3  to  7  depending  upon  the  de- 
tailed relationship  between  the  pattern  elements.   Of  course. 
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the  two  situations  are  not  particularly  related  except  in  the 
spacial  distribution  of  elements.   Second,  there  is  very  little 
difference  in  performance  as  a  function  of  the  shape  of  the 
spacial  array  (in  comparison  to  the  performance  differences  be- 
tween the  given  patterns  in  Experiment  2) ,  but  these  significant 
differences  in  performance  as  a  function  of  the  number  of  ele- 
ments in  the  array. 
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4.     PATTERN  RECOGNITION  IN  SHORT-TERM  MEMORY 

The  experiments  described  in  Section  3  involve  information 
transmission  measured  through  the  subject's  total  report.   It 
has  been  pointed  out  that  the  major  limitation  of  psychophysical 
measurements  involving  total  report  is  the  apparent  saturation 
of  the  span  of  immediate  memory  on  relatively  short-duration 
exposures.   For  instance,  in  only  a  very  few  cases  of  the  pat- 
terns described  in  Experiment  2  were  subjects  able  to  relate  cor- 
rectly (in  the  best-fit  sense)  more  than  about  six  of  the  ten 
squares  forming  each  of  the  (10) -patterns .   Subjective  reports 
indicate  that  subjects  saw  many  more  things  than  they  were  able 
to  report.   Thus,  we  conclude  that  there  is  much  more  informa- 
tion available  in  short-duration  visual  exposures  than  can  be 
recalled  in  total-report  experiments. 

The  total  report  of  information  perceived  through  short 
glances  is  a  very  artificial  means  of  information  utilization. 
In  the  normal  visual  situation,  information  perceived  in  short 
glances  is  not  reported  at  each  glance;  rather,  it  is  trans- 
ferred from  glance  to  glance  in  a  way  that  provides  a  net  in- 
formation intake  very  much  higher  than  that  predicted  on  the 
basis  of  short-duration  visual  exposures  such  as  those  measured 
in  Section  3. 

The  saturation  of  immediate  memory  requires  further  dis- 
cussion.  In  Section  2  it  was  noted  that  all  psychophysical 
experiments  involve  two  raechanisms--the  stimulated  modality 
and  the  response  mechanism.   It  does  not  stretch  the  imagination 
(or  the  great  bulk  of  physically  measured  data) ,  to  assume  that 
information  cannot  be  transferred  directly  from  visual  to  speech 
output  without  processing  in  the  higher  brain  centers.   The  span 
of  immediate  memory  limitation  may  not  be  imposed  by  the  in- 
formation available  in  vision,  but  rather  by  the  information 
that  can  be  conveniently  transferred  in  one  "clump"  from  the 
visual  modality  to  speech  or  to  the  motor  system  for  written 
reports.   To  avoid  the  psychophysical  bind,  or  bottleneck,  ap- 
parently caused  by  the  higher  brain  centers,  information  avail- 
able before  the  brain  has  been  sampled  in  a  series  of  visual 
modality  experiments.   The  basic  premise  of  this  experimenta- 
tion is  that  if  we  require  only  a  minimal  amount  of  information 
to  be  transferred  to  the  response  modality,  we  can  infer  a 
great  deal  more  about  the  information  that  must  have  been 
available  to  make  the  single  or  very  low-order  decision  actu- 
ally reported.   Experiments  of  this  type  have  indicated  through 
the  higher  information  rate  figures  they  report  that  very  im- 
portant, high-capacity  buffer  storage  exists  in  the  visual 
system  (1,  2).   Furthermore,  these  experiments  indicate  that 
this  buffer  storage  is  a  very  important  mechanism  in  the  recep- 
tion of  visual  information. 
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In  this  section  problems  of  pattern  recognition  (or  spacial 
relations)  in  the  short-term  memory — which,  in  general,  are  not 
treated  in  the  literature — are  considered.   A  sampling  technique 
for  the  measurement  of  short-term  memory  effects,  especially  as 
they  relate  to  pattern  recognition,  has  been  devised,  and  a 
sampling  experiment  intended  to  point  out  the  significant  dif- 
ferences between  pattern  recognition  involving  short-term  memory 
and  pattern  recognition  involving  total  report  has  been  per- 
formed.  This  experiment  is  described  and  pertinent  literature 
on  short-term  memory  effects  in  vision  is  discussed. 

4. 1  Short-Term  Memory  in  Vision 

Though  many  psychophysical  experiments  on  vision  require 
partial  report  by  the  subjects  (3,  4,  5),  the  first  comprehensive 
experiments  regarding  sampling  of  the  information  available  in 
short-term  visual  presentations  were  performed  by  Sperling  (1) , 
and  by  Averbach  and  Coriell  (6).   In  addition,  Averbach  and 
Sperling  have  presented  a  comprehensive  measurement  of  the  role 
of  short-term  memory  in  vision  (2) .   These  researchers  have 
demonstrated  that  the  visual  process  involves  a  high-capacity 
buffer  storage  with  essentially  instantaneous  information  read- 
in  and  relatively  slow  information  read-out.   This  buffer  storage 
is  susceptible  to  erasure  and  confusion  and  has  a  very  high  ca- 
pacity compared  with  the  normal  amount  of  information  one  measures 
in  visual-transmission  experiments.   For  instance,  the  buffer 
storage  has  been  shown  to  have  a  capacity  of  at  least  seventy 
information  bits,  compared  with  five  to  ten  bits  ordinarily  trans- 
mitted per  exposure  by  total  report.   The  decay  and  erasure  char- 
acteristics of  this  phenomenon  have  been  carefully  investigated 
by  Averbach  and  Sperling. 

It  is  the  author's  contention  that  the  major  contribution 
of  Averbach  and  Sperling's  work  does  not  lie  in  their  excellent 
measurements  of  the  role  of  short-term  memory  in  the  visual 
process.   Rather,  they  have  demonstrated  a  technique  for  compre- 
hensive psychophysical  measurements  which  do  not  suffer  from 
the  span  of  immediate  memory  limitations  ordinarily  encountered 
in  such  experiments.   Further,  their  technique  permits  inferences 
about  the  visual  information  available  before  the  higher  brain 
centers.   The  significance  of  measurements  on  visual  information 
availability  early  in  the  visual  information-processing  chain  is 
almost  unlimited.   In  television  transmission  problems  one  is 
intimately  concerned  with  the  question  of  ability  to  transfer 
information  from  frame  to  frame.   To  investigate  what  kind  of 
information  can  be  carried  from  one  to  another  short-term  ex- 
posure, one  must,  of  course,  have  techniques  for  measurement 
that  do  not  involve  total  report.   The  really  interesting  (and 
most  common)  phenomena  in  vision  do  not  involve  total  report; 
but  it  is  safe  to  assume  that  these  visual  processes,  which  are 
responsible  for  the  large  intake  of  visual  information  in  normal 


71 


operation,  involve  the  transfer  of  information  from  short-term 
memory  between  successive  exposures  to  extremely  complex  visual 
stimuli.   Furthermore,  it  is  most  probable  that  such  visual  in- 
formation processing  must  be  under  strong  control  of  the  higher 
brain  centers.   Work  on  the  octopus  (7)  and,  to  a  certain  ex- 
tent, on  the  human  (8)  has  indicated  that  certain  visual  recogni- 
tion processes  involve  efferent  information  from  the  higher 
brain  centers.   Presumably,  this  information,  which  enters 
retinal  ganglia,  influences  the  mechanism  of  transfer  in  the 
short-term  visual  memory. 

It  is  interesting  to  note  that  despite  their  detailed 
quantitative  measurements,  Averbach  and  Sperling  still  admit 
that  short-term  memory  in  vision  may  not  be  as  distinct  from 
common  afterimage  phenomena  as  one  might  suspect.   Thus,  the 
role  of  visual  afterimages,  generally  associated  with  short- 
duration  displays,  remains  essentially  unresolved  with  respect 
to  normal  processes.   Common  afterimage  phenomena  may  merely 
be  the  manifestation  of  the  truncation  of  sequential  visual 
stimuli — that  is,  they  may  be  the  manifestation  of  the  eye's 
"surprise"  at  its  inability  to  transfer  information  to  another 
glance. 

4.2  A  Sampling  Technique  for  the  Measurement  of 

Short-Term  Memory  Effects 

The  results  of  Experiment  2  clearly  demonstrate  the  satura- 
tion of  the  span  of  immediate  memory  in  pattern  recognition. 
To  surmount  this  difficulty  in  assessing  the  information  avail- 
able earlier  in  the  visual  processing  chain  in  short-duration 
pattern  exposures,  an  approximate  and  to  a  certain  extent 
arbitrary  sampling  technique  has  been  devised  for  use  in  con- 
nection with  pattern  exposures  identical  to  those  used  in  Ex- 
periment 2.   Its  choice  is  based  upon  two  major  considerations. 

1.  It  is  to  be  used  in  a  pattern-recognition  experiment 
aimed  at  emphasizing  the  differences  between  total  report  and 
partial  report  information  transmission. 

2.  It  is  to  be  consistent  with  the  best-fit  grading  tech- 
nique described  in  Section  3 . 

A  pattern  (the  test  pattern)  is  exposed  to  the  subject  for 
some  duration  T.      After  d   frames  of  white  field,  a  pair  of  pos- 
sible pattern  elements  are  shown  (see  Figure  4.1).   The  subject 
is  asked  to  decide  whether  this  pair  was  an  exact  pair  from 
the  pattern.   To  implement  such  a  procedure  satisfactorily, 
one  half  of  the  pairs  is  taken  exactly  from  the  original  pat- 
tern; and  one  half  differs  in  only  a  single  position  of  one  of 
the  two  elements  in  such  a  way  that  this  pair  does  not  form 
another  pair  (if  possible).   The  sample  pairs  for  a  (5)-pattern, 
which  conform  to  this  definition,  are  shown  in  Figure  4.2. 
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When  the  subject  is  shown  a  pattern  and  later  asked  to 
make  a  forced  choice  as  to  whether  a  pair  of  elements  subse- 
quently exposed  was  part  of  the  pattern,  guessing  becomes  a 
significant  response  artifact.   The  standard  guessing  correc- 
tion factor  for  a  two-alternative  forced  choice  must  be  applied 
to  the  subject's  response. 

Number  Correct  -  Number  Wrong      ,-  -.  . 
%  Correct  =  Total  Number  Shown  ^^'^^ 

Once  the  experiment  has  been  performed,  we  wish  so  to  re- 
late its  results  to  the  original  pattern  that  we  are  able  to 
infer  from  the  subject's  performance  in  the  identification  of 
possible  pattern  pairs  how  well  he  must  have  related  (in  the 
best-fit  sense)  the  various  elements  of  the  pattern  itself.  In 
other  words,  we  want  indirectly  to  measure  the  information  that 
must  be  available  on  the  average  for  the  subject  to  distinguish 
correctly  the  pairs  of  pattern  elements  on  subsequent  presenta- 
tion. .    ,   s   . 

For  a  pattern  of  n   elements,  the  number  of  pairs  (n  ) ,  is 

given  by  Equation  (4.2). 


n 
n. 


V  "  (n  -  2)  !  2!  ^^-^^ 

If  the  subject  were  able  to  respond  correctly  to  a  given 
percentage  of  these  pairs,  one  could  relate  the  percentage  of 
pairs  correctly  perceived  to  the  number  of  elements  that  must 
be  correctly  related  in  the  pattern  by  the  subject.  The  rela- 
tionship between  S^,  the  percentage  of  sample  pairs  correctly 
reported,  and  yiq  ,  the  number  of  elements  of  the  pattern  cor- 
rectly related,  is  given  by  Equation  (4.3). 

n       _  ]_ 


a        n  (n 


k   =    1 


where  S      =   the  percentage  of  samples  correctly  reported,  n   =   the 
number  of  squares  in  the  pattern,  and  n^    the  number  of  squares 
that  must  have  been  correctly  related  by  the  subject  to  achieve 
the  level  of  performance  indicated  by  5^ .   Equation  (4.3)  is 
plotted  in  Figure  4.3  for  n  =  5  and  n  =  10. 

For  best  results,  it  is  apparent  that  all  possible  sample 
pairs  from  a  given  pattern  should  be  used.   However,  this  is 
not  convenient  for  large  n.   From  Equation  (4.2)  we  see  that 

n  =  5    n   =10 
n   =    6        n^  =  15 


n  =  10   n^  =  45 


n  =  15  nZ   =    105 
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TO  eliminate  the  possibility  of  learning  (the  transferral  of 
information  between  subsequent  exposures  of  the  same  pattern) , 
mSnHifferent  patterns  must  be  interlaced  in  any  given  experi- 
mental seqSence^   Thus,  not  only  is  the  number  of  possible  pairs 
Tarle     but  also  the  number  of  exposures  that  must  be  used  to 
^^roid 'undesirable  effects  is  even  larger, 
avoid  undesir  ^^_^  ^^^pi^^g  measurement  on  (10) -patterns ,  where 

there  are  45  possible  element  pairs,  some  further  approxima- 
tions are  required.   Instead  of  testing  all  element  pairs, 
on?y  ten  are^selected.   These  are  chosen  such  that  each  pattern 
element  is  represented  in  at  least  two  pairs  (generally  one 
coSeSt  pair  and  one  incorrect  pair).   Thus,  only  about  22  per- 
cent of  the  possible  pairs  are  tested. 

4.3  Sampling  Experiment 

A  comprehensive  sampling  experiment  (Experiment  4)  was 
conducted  with  seven  of  the  twenty  patterns  used  m  Experiment  2. 

Experiment    4 

Three  subjects  were  tested  with  a  sampling  of  pattern  pairs 
from  seven  of  the  patterns  used  in  Epxeriment  2    Ten  sample- 
pair  exposures  (five  correct  and  five  incorrect)  were  used  on 
each  pattern  for  each  delay  between  pattern  and  sample.   The 
experimental  sequence  shown  in  Figure  4.1  was  used  for  each  ex- 
posure.  Both  the  pattern  and  pattern  ^^^P^^  P^^f,/^^^.  ^^P°f  ^ 
for  ten  frames  (-  625  msec).   The  patterns  (B) ,  (J),  (6),  and 
(8)    we?e  tested  at  delays  of  1,  2,  5,  10,  and  20  frames;  patterns 
F   Is?,  and  (10)  were  tested  only  at  1,  10,  and  20  frames  of 
delay   Each  subject  was  instructed  as  follows  after  a  few 
sample  exposures  were  shown:   "In  the  four-second  period  follow- 
ing each  pattern  pair,  you  are  to  indicate  verbally  whether 
that  pattern  pair  was  identical  to  a  pair  of  elements  in  the 
pattern  shown  previously.   Remember,  every  pattern  pair  has  one 
element  that  is  identical  to  an  element  m  the  pattern;  the 
second  element,  in  general,  is  not  far  removed  from  a  correct 
position.   I  (the  experimenter)  will  record  your  answers  as 
they  are  given."   Three  hundred  exposures,  as  shown  in  Figure 
4.1,  were  required  to  provide  ten  samples  at  each  delay  for 
every  pattern.   The  running  time  of  the  movie  was  fifty  minutes 
including  a  five-min  break  at  the  halfway  point.   The  300  ex- 
posures were  in  a  pseudorandom  order  with  respect  to  pattern 
and  delay.   The  subjects  were  seated  9  ft  from  the  screen  such 
that  the  patterns  subtended  angles  of  approximately  10  deg  to 
the  subject.   Experimental  conditions  were  identical  to  those 
in  Experiments  2,  3,  and  3A. 

Before  this  technique  was  implemented  in  movie  form  for 
complete  testing,  several  pilot  films  were  made  to  determine 
the  most  appropriate  exposure  parameters.   The  results  indicated 
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that  performance  (percent  pairs  correct  versus  delay)  does  not 
consistently  rise  above  the  guessing  level  (50  percent)  until 
both  the  pattern  and  pattern  sample  pair  are  exposed  for  at 
least  five  frames  each.   One  subject  (the  author)  was  able  to 
achieve  scores  of  60  to  70  percent  for  two  frames  of  pattern 
and  sample  exposure,  but  only  for  zero  to  one  frame  of  delay. 
There  are  several  reasons  for  these  results.   First,  it  is  im- 
possible for  the  subject  even  to  "see"  the  entire  pattern  for 
one-  or  two-frame  exposures;  and,  because  the  two  elements 
from  the  sample  often  come  from  different  parts  of  the  pattern, 
the  result  is  not  unexpected.   Furthermore,  even  though  one-  or 
two-frame  exposures  in  Experiment  2  result  in  best-fit  grades 
of  up  to  four  elements  (see  Figures  3.5  and  3.6),  these  elements 
are  always  reported  from  a  local  region  of  the  pattern  and  the 
poor  results  indicated  from  the  preliminary  testing  are  not  in- 
consistent with  Experiment  2.   Second,  the  few  instances  of  bet- 
ter performance  are  most  probably  due  to  the  subject's  detection 
of  apparent  motion  (9,  10).   To  all  practical  purposes  the  de- 
tection of  apparent  motion  is  performed  well  by  peripheral  vi- 
sion; thus  eye  movement  or  scanning  would  not  be  a  significant 
factor.   When  two  still  pictures  are  sequentially  displayed 
with  a  small  delay  between  them,  the  subject  recognizes  that 
they  are  different  (if  they  are)  by  sensing  that  something  has 
"moved."   This  effect  is  discussed  at  length  in  connection  with 
the  results  of  Experiment  4. 

When  a  plain  white  background  was  used  during  the  delay 
interval,  as  opposed  to  the  blank  pattern  matrix,  poorer  per- 
formance was  noted.   In  effect,  the  absence  of  a  continuing 
position  reference  during  the  delay  interval  forces  the  subject 
to  retain  absolute  registration  data  to  avoid  reorientation 
when  the  sample  pair  (and  pattern  matrix)  reappear.   Thus,  it 
was  decided  to  use  the  blank  matrix  for  background  both  in  the 
delay  interval  and  report  interval. 

Figure  4.4  depicts  the  average  number  of  correctly  related 
pattern  elements  (n^)  as  a  function  of  delay  between  pattern 
exposure  and  sample  exposure  for  the  (5) -patterns  (B) ,  (F) ,  and 
(J).   The  grade  n^    is  computed  from  Equation  (4.3)  using  the 
value  of  Sq   based  on  the  average  number  of  samples  correctly 
recognized  by  three  subjects.   The  guessing  correction  factor 
given  by  Equation  (4.1)  also  has  been  applied  to  the  experimental 
data.*   The  same  results  are  plotted  in  Figure  4.5  for  the  (10)- 
patterns  (3) ,  (6) ,  (8) ,  and  (10) .   The  n^    =    Q    line  is  the  locus 
of  points  for  which  the  number  of  correctly  recognized  samples 
is  below  the  chance  level  (50  percent) . 

*T'he    experimental    data    are    tabulated    in   Appendix    B,    Table    B-5. 
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In  general,  as  the  delay  approaches  zero*  the  performance 
difference  between  patterns  is  much  smaller  with  the  sampling 
experiment  than  with  the  total-report  experiment  (Experiment  2) . 
As  the  delay  is  increased,  there  is  a  marked  difference  between 
patterns.   Performance  with  patterns  (6)  and  (10) ,  classified 
random  in  Experiment  1,  deteriorates  rapidly,  with  delays  great- 
er than  one  frame  falling  immediately  below  the  chance  level. 
The  (B)  pattern,  also  classified  random,  exhibits  a  slower  de- 
terioration of  performance  with  delay.   The  structured  patterns 
(8),  (J),  and  (F)  are  characterized  by  high  levels  of  performance 
virtually  independent  of  delay.   In  general,  the  short-delay 
performance  is  higher  than  the  performance  measured  by  total 
report  in  Experiment  2.   The  most  marked  differences  occur  for 
the  random  patterns  (6) ,  (10) ,  and  (B) ,  which  clearly  indicates 
the  effects  of  short-term  memory  in  improving  performance. 
The  small  number  of  samples  (ten)  used  with  the  (10) -patterns 
has  the  effect  of  exaggerating  the  time  dependence  of  perform- 
ance.  The  total  number  of  samples  identified  actually  falls 
to  about  one  half  of  the  one-frame  delay  value  at  twenty-frames 
delay.   In  addition,  because  only  22  percent  of  the  possible  ele- 
ment pairs  are  sampled  for  (10) -patterns ,  one  can  only  interpret 
these  results  qualitatively. 

4.4  Short-Term  Memory  Pattern  Recognition  in 
Relation  to  Total  Report 

In  Experiment  2,  which  involves  total  report  of  the  ele- 
ments of  a  five-  or  ten-element  pattern,  the  number  of  elements 
that  can  be  correctly  reported  differs  considerably  as  a  func- 
tion of  the  pattern.   For  instance,  after  an  exposure  of  ten 
frames  (-  62  5  msec)  the  average  number  of  correctly  reported 
elements  (in  the  best-fit  sense)  was  6.8  for  pattern  (8)  and 
2.2  for  pattern  (10).   In  the  sampling  experiment  described  in 
section  4.3,  we  inferred  that  one  frame  (62  msec)  after  a  ten- 
frame  exposure  the  subject  can  relate  about  5.2  elements  from 
pattern  (10)  as  opposed  to  7.4  elements  from  pattern  (8).   Thus, 
in  reports  that  draw  information  from  the  short-term  memory, 
random  and  structured  pattern  sources  have  less  influence  on 
performance.   The  general  compression  of  performance  difference 
between  patterns  as  measured  by  the  sampling  experiment  indicates 
that  the  short-term  memory  provides  a  nearly  eidetic  memory  com- 
ponent for  very  short  delays.   The  extent  to  which  this  eidetic 
behavior  is  related  to  the  detection  of  apparent  motion  in 
peripheral  vision  is  not  clear  from  Experiment  4.   Wertheimer's 
(9)  data  indicate  that  a  60-msec  delay  between  stimuli  results 

*T'he    best-fit   grades    for    Experiment    2    at    ten-frame    exposure 
are   plotted   on    the   n  -axis    for   Figures    5.4    and    5.5    for    refer- 
ence . 
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in  optimal  apparent  motion  detection.   However,  the  coarseness 
of  the  sampling  measurement  is  really  responsible  for  the 
sharp  decay  of  performance.   The  actual  decay  is  much  more 
gradual,  indicating  that  performance  remains  above  the  total 
report  level  for  at  least  five  frames. 

The  difference  in  information  transmission  measured  with 
total  report  and  the  sampling  technique  is  considerable.   At 
one-frame  delay  a  transmission  upper-bounded  by  24.4  bits  from 
pattern  (10)  is  measured.   The  upper  bound  on  transmission  for 
the  same  exposure  duration  (ten  frames)  of  10.4  bits  is  measured 
with  total  report. 

The  decay  of  performance  for  long  delays  to  the  immediate 
(permanent)  memory  level,  as  described  by  Averbach  and  Sperling 
(2) ,  should  result  in  a  gradual  decrease  in  n^  to  the  level 
measured  in  Experiment  2  for  a  ten-frame  exposure.   This  decay 
is  very  slow  for  highly  structured  patterns  and  more  rapid  for 
random  patterns  [see  Figures  4,4  and  4.5,  patterns  (B) ,  (6), 
(10)].   The  immediate  memory  level  for  the  structured  patterns 
is  probably  higher  in  Experiment  4  because  of  the  large  number 
of  exposures  which  must  be  used  for  each  pattern.   Neverthe- 
less, the  decay  of  short-term  memory  to  the  immediate  memory 
level  is  clearly  demonstrated  to  depend  upon  the  pattern  source, 
with  random  patterns  characterized  by  decay  in  two  to  ten 
frames  (125  to  625  msec)  and  structured  patterns  characterized 
by  decay  in  greater  than  twenty  frames  (1.25  sec).   Note  that 
pattern  (B) ,  a  random  (75  percent  by  Experiment  1)  (5) -pattern, 
decays  more  slowly  than  pattern  (6) ,  a  random  (65  percent  by 
Experiment  1)  (10) -pattern;  and  that  again  the  random-structured 
differences  are  more  pronounced  with  (10) -patterns  than  with 
(5) -patterns. 

4.5  Conclusions 

The  following  conclusions  describe  the  differences  between 
total-report  and  short-term  memory  performance: 

1.  The  sampling  technique  described  in  section  4.2  pro- 
vides a  means  of  measuring  short-term  memory  effects;  but  the 
use  of  only  ten  samples  for  ten-element  patterns  results  in  a 
very  coarse  measurement  somewhat  dependent  upon  the  samples 
selected.  The  sampling  experiments,  as  implemented  here,  be- 
come impractical  for  more  complicated  patterns. 

2.  There  is  more  information  available  in  short-term 
memory  than  is  reported  with  total-report  techniques  for  the 
same  exposure  duration.   While  exact  information  measures  do 
not  exist  for  patterns,  a  difference  of  about  2:1  in  bits  is 
estimated  for  some  patterns. 

3.  The  short-term  memory  contains  an  eidetic  component 
which  results  in  more  similar  performance  for  all  patterns  for 
very  short  delays.   The  performance  difference  is  compressed 


81 


from  1.7  elements  to  1  element  for  (5) -patterns  and  from  4.6 
elements  to  2 . 6  elements  for  (10) -patterns . 

4.   The  random-structured  grouping  serves  as  a  basis  for 
predicting  short-term  memory  performance  with  respect  to 
level  for  short  delays  and  nature  of  decay  with  increasing 
delay.   Random  patterns  decay  faster  than  structured  patterns; 
this  effect  is  more  pronounced  for  (10) -patterns  than  for  (5)- 
patterns.   While  decay  to  the  immediate  memory  level  has  not 
been  demonstrated,  we  estimate  that  this  decay  requires  less 
than  five  frames  for  random  (10) -patterns  and  more  than  twenty 
frames  for  random  and  structured  (5) -patterns ,  with  structured 

(5) -patterns  showing  no  appreciable  decay  up  to  twenty  frames 

(1.25  sec) . 
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5.  SOME  SYSTEM  ASPECTS 

In  sections  3  and  4  the  major  emphasis  was  on  performance 
as  a  function  of  the  properties  of  the  spacial  distribution  of 
pattern  elements.   In  this  section  several  aspects  of  vision  that 
are  not  particular  to  detailed  spacial  distributions  are  discussed. 
The  effects  of  dispersion  or  size,  duration  of  the  glance,  the 
element  context,  and  eye  motion  are  considered.   Some  experiments 
intended  to  point  out  these  effects  are  included  in  this  section. 
And,  results  reported  in  Appendixes  A  and  C  are  related  to  the 
pattern-recognition  experiments. 

5. 1  Total  Report  and  Pattern  Recognition  from  a  Linear  Array 

The  major  difference  between  Experiments  3  and  3A  and  other 
tachistoscopic  investigations  using  arrays  of  English  letters  is 
that  the  exact  position  of  the  letters  is  unknown  to  the  subject 
until  the  pattern  is  exposed  (1,  2).   in  addition,  the  array  is 
large  (10  deg  in  the  horizontal  direction  by  about  7  deg  in  the 
vertical  direction) ,  and  the  number  of  letters  in  each  array  is 
unknown  (to  within  one  of  two  possibilities).   Furtheimiore ,  the 
results  of  Experiment  3  indicate  that,  under  the  circumstances 
described  above,  about  one  letter  less  can  be  reported  on  the  aver- 
age from  ten-letter  patterns  than  from  five-letter  patterns  for 
exposure  durations  between  two  and  twenty  frames.   To  help  explain 
this  phenomenon  and  assess  the  effects  of  unknown  positions  within 
the  array,  the  following  experiments  were  conducted. 

Experiment    5A 

Six  subjects  were  exposed  to  a  sequence  of  twelve  arrays  of 
ten  letters  each,  chosen  from  zero-gram  English.   The  letter  ar- 
ray, consisting  of  two  rows  of  five  letters  each  occupying  adja- 
cent positions  in  the  pattern  matrix  (see  Fig.  5.1,  sample  array 
A) ,  was  shown  to  the  subjects  before  the  experiment,  and  a  few 
sample  exposures  preceded  the  test  exposures.   Experimental  condi- 
tions were  identical  to  those  in  Experiment  3,  except  that  two  dif- 
ferent sets  of  letters  were  used  at  each  exposure  duration.   Ex- 
posure durations  of  1,  2,  5,  10,  20,  and  50  frames  were  used  in  a 
random  order.   The   subjects  responded  by  marking  down  as  many  let- 
ters as  possible  from  each  exposure,  beginning  their  report  after 
the  exposure  was  over.   The  movie  (and  experiment)  running  time 
was  about  three  minutes. 

Experiment    SB 

Experiment  5B  was  identical  to  5A  except  for  the  letter  array 
used.   A  more  widely  spaced  two-line  array  (see  Fig.  5.1,  sample 
array  B)  centered  at  approximately  the  middle  of  the  pattern  ma- 
trix was  chosen.   The  same  exposure  durations  were  used  with  the 
same  six  subjects.   This  experiment  followed  Experiment  5A  and  ran 
for  approximately  three  minutes. 
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The  results  of  these  experiments  are  plotted  in  Figure  5.1. 
The  letter  recall  for  the  shortest  exposures  differs  by  only  0.5 
to  0.7  letters  (on  the  average)  from  the  results  of  Experiment  3 
with  unknown  arrays.   After  about  twenty  frames  (approximately 
1  sec)  the  fact  that  the  array  is  unknown  makes  little  difference 
in  performance.   Presumably,  the  eyes  have  ample  time  to  search 
the  matrix  for  durations  of  this  length.   Note  that  the  unknown 
arrays  [in  this  case,  patterns  (1),  (2),  (6),  (8)],  in  general, 
are  more  dispersed  than  either  of  the  known  arrays  (A  and  B) . 
Thus,  it  cannot  be  said  with  certainty  whether  dispersion  or 
lack  of  a  priori  letter-position  knowledge  is  responsible  for  the 
difference  between  the  A  curve  and  unknown  array  curve  in  Figure 
5.1. 

The  difference  between  performance  with  array  A  and  array  B 
is  also  worthy  of  comment?  the  larger  array  is  conducive  to  bet- 
ter performance  (by  an  average  of  0.6  letters)  for  short  dura- 
tions.  This  difference  (almost  identical  to  that  between  five- 
letter  and  ten-letter  curves  in  Fig.  3.17)  strongly  suggests  that 
dispersion  helps  performance  for  a  range  of  exposure  durations 
when  one  is  concerned  with  the  report  of  unrelated  items.   In 
both  the  A-  and  B-array  experiments  the  percentage  of  incorrectly 
reported  letters  was  2.5  to  3  percent.   Thus,  confusion  caused  by 
proximity  is  not  the  major  cause  for  the  difference  in  performance, 
Furthermore,  these  conclusions  can  be  extrapolated  to  the  unknown 
array  situation  (Experiment  3)  and  result  in  complete  agreement 
with  measured  performance.   Consider  the  letter-report  curves  for 
patterns  (H)  and  (J)  in  Figure  3.18  and  patterns  (1)  and  (8)  in 
Figure  3.19.   Pattern  (1),  a  symmetric  dispersed  array  quite  simi- 
lar to  known  array  B,  begins  significantly  poorer  than  (8),  but, 
for  two-  and  ten-frame  exposures,  results  in  improved  performance. 
Pattern  (H) ,  a  larger  inverted  version  of  (J) ,  results  in  improved 
performance  for  one-  and  two-frame  exposures.* 

The  long-duration  asymptotes,  though  their  difference  in  the 
three  curves  in  Figure  5.1  is  only  about  1.2  letters,  are  also 
consistent  with  data  for  individual  unknown  arrays.  Curves  A  and 
B  indicate  that  dispersion  results  in  lower  performance  for  long- 
duration  exposures.  The  unknown  curve  lies  between  A  and  B,  and 
it  is  clear  that  for  the  unknown  patterns  used  any  six  or  so  ele- 
ments are  less  separated  than  those  in  B. 

Simple  pattern-recognition  experiments  also  were  performed 
with  a  1  X  6  linear  array  of  black  and  white  squares  or  numerals 
(see  Figs.  A.l  and  C.6).   Details  are  discussed  in  Appendixes  A 
and  C.   The  experiments  are  cited  here  {1)    to  demonstrate  spacial 
span  of  apprehension  in  the  horizontal  and  vertical  directions, 

*Note    that    this    is    exactly    opposite    to    performance    in    Experi- 
ment   2    for    the    same   patterns . 
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and  (2)    to  demonstrate  ways  in  which  performance  in  pattern- 
recognition  tasks  involving  short-duration  exposures  may  be 
modified  virtually  independent  of  the  stimulus  details. 

Figure  5.2  demonstrates  position-error  distributions  aver- 
aged over  all  the  exposure  durations  for  independent  measurements 
with  a  vertically  and  horizontally  oriented  1x6  array.   Sub- 
jects were  asked  to  indicate  the  positions  of  the  white  squares 
in  each  short-duration  exposure  which  consisted  of  one,  two, 
three,  or  four  white  squares.   The  vertical  error  characteristic 
is  almost  exactly  the  same  as  the  horizontal  error  characteris- 
tic rotated  90  deg  clockwise,  the  same  rotation  applied  to  the 
display  matrix  to  project  the  array  with  vertical  orientation. 
Thus,  subjects  perform  better  going  from  top  to  bottom  and  from 
left  to  right.   The  data  in  Figure  5.2  show  that  subjects  are 
equally  adept  at  horizontal  or  vertical  position  location.   The 
effect  of  edge  cues  is  also  apparent  from  this  figure.   The  low- 
est errors  occur  at  the  top  and  bottom  and  left  and  right  edges 
of  the  display.  %  ERROR 
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F%gure    5.2,       Horizontal    and    Vertical    Position   Error   Distribution 
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The  curve  in  Figure  5.2  demonstrates  what  might  be  temmed 
the  average  subject's   spacial  span  of  apprehension  bias  (for  an 
array  of  dimension  6).   This  bias,  which  is  indicated  in  the  re- 
sults of  position-report  accuracy  discussed  in  section  5.4,  is 
felt  to  be  a  general  aspect  of  behavior  with  matrix  patterns. 

The  error-versus-exposure-duration  curves  for  the  same  stim- 
ulus material  (Figs.  A. 2,  C.3,  and  C.4)  exhibit  pronounced  peaks 
at  intermediate  durations  for  numeral-report  and  position-report 
experiments.   These  curves  indicate  that  increased  exposure  to 
the  stimulus  material  does   not  result  in  improved  performance 
for  all  cases.   The  naive  notion  that  information  processing  oc- 
curs at  a  constant  rate  through  the  one-glance  region  cannot  be 
applied  to  all  stimulus  exposures.   Furthermore,  the  exposure 
durations  at  which  increased  confusion  occurs  (approximately  50 
to  100  msec)  are  close  to  exposure  durations  for  which  the  Broca- 
Sulzer  phenomenon  (3)  has  been  shown  to  cause  artificial  bright- 
ness enhancement  (50  msec)  and  to  the  latency  interval  for  volun- 
tary eye  motion  (4).   Note  that  seven  of  the  twenty  patterns 
used  in  Experiment  2  with  best-fit  grading  exhibit  poorer  per- 
formance at  exposure  durations  of  two  frames  (approximately 
120  msec)  than  at  one  frame.   Thus,  aspects  of  the  visual  system 
serve  to  complicate  the  considerations  upon  which  any  processing 
model  of  a  general  nature  is  based. 

5.2     Eye  Motion  Effects  in  Dispersed  Patterns 

It  was  pointed  out  in  section  2.4  that  eye  motion  becomes  a 
significant  aspect  of  information  retrieval  from  large  patterns 
(up  to  10  deg)  for  short-duration  exposures.   In  general,  the 
eye  executes  a  position-versus-time  curve  which  involves  the 
superposition  of  three  motion  components? 

1.  An  eye  tremor  of  small  amplitude  (a  few  seconds  of  arc) 
at  frequencies  of  30  to  70  cps; 

2.  An  erratic  random  motion  of  larger  amplitude  than  (1) ; 

3.  The  voluntary  and  involuntary  gross  eye  motions  required 
to  compensate  for  head  motion  and  object  tracking  (5,  6). 

The  gross  motion  effects  required  for  object  tracking  or  recogni- 
tion of  dispersed  patterns  are  of  particular  interest  here.  Though 
the  exact  mechanism  whereby  eye  motion  is  required  in  vision  is 
not  well  understood,  there  is  positive  evidence  that  visual  acu- 
ity is  seriously  affected  when  it  is  suppressed.   Ditchburn  and 
Ginsberg  (7)  and  Ditchburn  and  Fender  (8)  have  shown  that  when 
the  position  of  an  object  is  stabilized  on  the  retinal  surface, 
acuity  is  often  lost  entirely. 

In  this  section  measurement  of  gross  eye  motion  for  dis- 
persed patterns  is  considered  to  provide  a  basis  for  interpreta- 
tion (at  least  with  respect  to  eye  motion)  of  the  various  pattern- 
recognition  results  reported  earlier.   A  psychophysical  estimate 
of  dispersion  effects  is  discussed  in  the  next  section. 
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Basically,  there  are  two  ways  in  which  the  position  of  the 
eye  with  respect  to  the  head  may  be  measured.   The  first  involves 
electrical  recording  of  the  polarization  potential  of  the  eye- 
ball (9) .   The  second  involves  measurement  of  reflected  light 
either  directly  from  the  cornea  or  from  a  small  mirror  ground 
on  a  contact  lens  placed  over  the  cornea  (10) .   The  author  used 
a  device  suggested  by  Richter  and  Pflatz  (11)  and  developed  by 
Dr.  Lawrence  Stark  and  Messrs.  Laurence  Young  and  Alan  Sand- 
burg (12)  of  the  MIT  Electronic  Systems  Laboratory  for  the  hori- 
zontal eye  position.   This  device  measures  the  difference  in  the 
amount  of  light  reflected  from  the  dark  iris  area  and  "white" 
(sclera)  of  the  eye  as  a  function  of  eye  position.   It  permits 
the  measurement  of  eye  position  (via  a  dc  output  signal)  to  an 
accuracy  of  about  5  percent  after  appropriate  calibration.   Be- 
cause it  only  provides  a  measure  of  horizontal  eye  position  (in 
its  present  form) ,  the  horizontal  1x6  matrices  used  in  the  ex- 
periments described  in  Appendixes  A  and  C  were  the  input  stimuli. 

In  a  typical  measurement  situation  the  subject  is  seated 
6  ft  from  a  curved  screen.   His  head  is  held  rigid  in  an  ordi- 
nary baseball  catcher's  mask,  and  a  pair  of  clear  plastic  gog- 
gles, which  contain  the  light  sources  and  reflection  measurement 
sensors,  are  placed  over  his  eyes.   Figure  5.3  depicts  the  measure- 
ment configuration.   A  dual-track  chart  recorder  monitors  the 
projection  flash  and  the  dc  signal  proportional  to  horizontal 
eye  position. 

The  results  of  a  limited  measurement  program  using  this 
technique  provide  interesting,  objective  eye  motion  data  for 
further  interpretation  of  the  psychophysical  results.   Four 
measurements  of  eye  motions  were  made  for  two  subjects  under 
various  stimulus  conditions? 

1.  Exposure  to  numeral  plus  position  display  (Fig.  C.6  at 
30-msec  duration. 

2.  Exposure  to  numeral  plus  position  display  (Fig.  C.6  at 
100-msec  duration. 

3.  Exposure  to  position-only  display  (Fig.  C.l,  horizontally 
oriented)  at  60-msec  duration. 

4.  Exposure  to  position-only  display  (Fig.  C.l,  horizontally 
oriented)  at  100-msec  duration. 

In  all  cases  the  horizontal  extent  of  the  projected  pattern  was 
about  9  degs.   The  measured  data  are  summarized  in  Figures  5.4, 
5.5,  and  5.6  and  in  Table  5.1.   Figures  5.4  and  5.5  represent 
typical  eye  motion  traces  from  the  Sanborn  recorder  for  the  four 
stimulus  conditions.   These  traces  are  typical  of  the  many  re- 
cordings made  for  each  condition.   All  the  recordings  show  a  large 
sinusoidal  baseline  noise  level  due  to  electrical  disturbances 
created  by  the  projector  blower  and  all  are  for  the  same  subject. 
In  Figure  5.5a  the  60-msec  light  pulse  has  been  emphasized  for 
clarity.   All  other  light  pulses  (upper  traces)  begin  with  the 
sharp  upward  departure  from  the  baseline  and  end  with  the  begin- 
ning of  the  negative  backswing .   The  results  of  other  typical 
recordings  (not  depicted)  are  summarized  in  Table  5.1.   The  re- 
sults of  these  measurements  are  summarized  below. 
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Figure    5.3.       Horizontal    Eye   Motion   Measurement    Configuration 

1.  No  significant  eye  motion  (none  greater  than  1/2  deg) 
occurs  during  exposures  up  to  100-msec  duration.   In  general, 
latency  increases  as  the  flash  duration  is  decreased.   The  aver- 
age latency  for  100-msec  flashes  is  about  240  msec  as  opposed  to 
275  msec  for  30-msec  flashes.   The  latency  is  shorter  when  posi- 
tion-only displays  are  used  (averaging  about  175  msec) . 

2.  Postexposure  eye  motion  differs  in  accordance  with  the 
stimulus  material.   Numeral  plus  position  displays  are  followed 
by  greater  motion  almost  invariably  involving  a  center-to-right- 
to-center-to-left-to-center  sequence,  causing  excursions  of  about 
3  deg  right  of  center  to  2  deg  left  of  center,  with  fixation  in- 
tervals varying  from  150  to  700  msec  (see  Fig.  5.6).   Position- 
only  displays  almost  invariably  are  characterized  by  less  post- 
exposure motion  between  the  center  and  right  (2  deg) .   This  mo- 
tion takes  place  much  more  slowly  than  comparable  excursions  with 
numerals . 
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Horizontal    Eye   Motion   Recording s- 
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Figure    5.6.       Eye    Position    vs    Time--Numeral 
plus    Position    Display 

3.   At  60-msec  exposure  duration  with  position-only  displays, 
virtually  no  motion  is  recorded  except  a  very  slow  drift  less  than 
1/2  deg  in  amplitude.   This  duration  and  stimulus  result  in  the 
highest  error  for  the  experiments  described  in  Appendix  A. 

These  results  are  in  general  agreement  with  those  in  the 
literature  (4) . 

In  discussing  explanations  for  psychophysical  performance,  it 
is  a  reasonable  assumption  that  eye  motion  is  not  involved  as  such 
for  exposure  durations  less  than  about  four  frames. 
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Table  5 . 1 


Eye  Motion  Data  Summary 


Exposure    Description 


Trace      Latency 


Maximum   Right   and   Left 
Excursions 


(1) 

30-insec  < 

iuration, 

1 

230 

msec 

R~3° 

L— 1° 

numerals 

plus 

2 

300 

msec 

R— 1-1/2° 

L  — 1/2° 

position 

display 

3 

270 

msec 

R— 1-1/2° 

L— 1/2° 

4 

250 

msec 

R— 2° 

L— 1/2° 

5 

300 

msec 

R— 1-1/2° 

L— 1-1/2° 

6 

270 

msec 

R--l° 

L— 1° 

7 

300 

msec 

R--l° 

L  — 1° 

(2) 

100-msec 

duration , 

1 

230 

msec 

R— 3° 

L  — 1/2° 

numerals 

plus 

2 

250 

msec 

R— 1° 

L— 2° 

position 

display 

3 

250 

msec 

R— 1/2° 

L--l/2° 

4 

250 

msec 

R— 2-1/2° 

L— 2-1/2° 

5 

320 

msec 

R— 3° 

L--l-l/2° 

(3) 

60-msec  duration, 

12 

avg 

=r 

Very  littli 

e  motion; 

position- 

-only 

200 

msec 

all  less  than  ±1/2  deg 

display 

from  cente: 

r 

(4) 

100-msec 

duration, 

1 

200 

msec 

R~l-l/2° 

position- 

-only 

2 

220 

msec 

Very  littli 

o 

display 

3 

150 

msec 

L--l/2° 

4 

125 

msec 

L— 1/2° 

5.3  Psychophysical  Estimate  of  Dispersion  Effects 

A  psychophysical  experiment  was  conducted  to  illustrate  the 
effects  of  display  dispersion  on  performance.   The  task  selected 
for  testing  involved  counting  the  number  of  times  in  a  long  se- 
quence that  three  English  letters  projected  simultaneously  were 
identical.   To  eliminate  confusion  and  minimize  the  effects  of 
reading  different  letters,  alternate  exposures  in  the  sequence 
were  drawn  from  the  A-B  and  C-D  ensembles.   Twenty  exposures  were 
used  in  each  run.   At  each  combination  of  single-exposure  duration 
and  distance  between  letters,  a  high  and  low  count  run  were  used. 

Experiment    6 

Ten  subjects  were  exposed  to  32  runs  of  three-letter  ex- 
posures similar  to  the  run  shown  in  Figure  5.9.   Exposure  times 
were  1,  2,  5,  and  10  frames;  distances  were  1.3,  2.1,  5,  and  8.8 
deg.   In  all  cases  the  center  letter  was  not  moved/  distance  was 
varied  by  equal  separation  of  the  right  and  left  letters.   A 
typical  run  began  with  a  2-sec  black  interval  (call  to  attention) 
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exDOsed   This  interval  was  followed  by  a  2-sec  white  interval, 
followed  by  the  20-exposure  run.   After  the  run  a  10-sec  report 
interval  was  projected.   The  subjects  were  instructed  to  count 
the  number  of  times  in  each  run  all  three  letters  in  an  exposure 
were  the  same--that  is,  AAA,  BBB ,  CCC,  or  DDD.   A  high  count  run 
(11  to  15)  and  a  low  count  run  (5  to  9)  was  used  at  each  experi- 
mental point  (distance-duration) .   Subjects  reported  by  writing 
their  count  for  each  run  on  an  answer  sheet.   Two  subiects, 
seated  to  the  right  and  left  of  the  projector  at  a  distance  of 
9  ft,  were  tested  in  each  session.   The  running  time  of  the  film 
(including  a  few  practice  runs)  was  about  14  min . 

The  results  of  Experiment  6,  which  are  plotted  in  Figures 
5  7  and  5.8,  demonstrate  that  in  general,  performance  improves, 
with  increasing  exposure  duration  and  decreasing  distance— a 
perfectly  reasonable  result.   The   one  exception  is  demonstrated 
Graphically  by  examining  the  1.3-deg  and  2 . 1-deg  separations  at 
an  exposure  duration  of  five  frames  (approximately  310  msec) . 
These  points  indicate  that  increased  separation  at  constant  ex- 
posure duration  is  required  to  improve  performance.   In  the  ab- 
sence of  other  corroborating  data,  one  might  dismiss  this  rela- 
tion as  a  product  of  experimental  inaccuracy.   However,  Figure 
5  1  shows  that  at  five-frames  duration  subjects  are  able  to 
report  significantly  more  letters  from  a  dispersed  array  than 
from  a  closely  spaced  array.   The  distances  between  letters  in 
these  arrays  (Experiment  5)  are  of  the  same  order  of  magnitude 
as  the  distances  involved  in  Experiment  6.  ^  ^.   ^u  • 

A  significant  experimental  artifact  is  demonstrated  by  this 
experiment.   The  data  in  Figure  5.8  for  durations  of  one  and  two 
frames  are  more  a  measure  of  counting  speed  than  letter  compari- 
sons and  the  tracking  required  to  make  them.   For  one-frame 
duration  per  exposure,  the  entire  twenty-exposure  run  lasts 
about  1.25  sec.   If  there  are  15  correct  counts  m  this  interval, 
the  subject  is  counting  at  an  average  rate  of  about  12  counts/sec. 
A  preliminary  pilot  film  and  very  limited  testing  indicated  that 
subjects  could  count  conveniently  only  at  rates  of  about  2/sec. 
Thus,  it  appears  that  the  counting  problem  is  the  major  diffi- 
culty encountered  at  one-  and  two-frame  exposures.   However,  the 
data  are  consistent  (as  evidenced  by  the  curves  m  Fig.  5.8); 
and,  more  important,  the  subjects  invariably  report  more  counts 
for  the  high-count  run  than  for  the  low-count  run  at  each  dura- 
tion-distance measure.   (See  Table  B.7,  Appendix  B.)        ,  ■   ^ 
The  author  finds  this  result  surprising  because  the  subject 
has  no  way  of  knowing  the  correct  count  for  any  run.   One  ex 
planation  lies  in  the  subjective  data  volunteered  by  some  sub- 
jects.  First,  it  is  virtually  impossible  to  count  anything  at 
all  for  the  short-duration  runs  in  the   normal  manner.   Only 
the  first  letters  are  seen  if  the  eye  continues  uninterrupted 
fixation.   Every  other  letter  is  seen  as  a  blur  because  of 
temporal  stimulus  masking  (13).   However,  many  subjects  re-      __ 
ported  blinking  their  eyes  and  "now  and  then  picking  up  a  count. 
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Figure    5.9.       Typical    Letter   Run --Experiment    6 
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Blinking  avoids  masking  by  previous  letters  and  should  result  in 
a  count  proportional  to  the  number  present  when  averaged  over 
several  subjects. 

Data  from  the  literature  (14)  as  well  as  the  measurements 
described  in  section  5.2  indicate  that  saccadic  motions  of  the 
order  of  10  deg  can  be  made  at  rates  up  to  300  deg/sec  after 
appropriate  latency  (in  this  case,  presumably  at  the  outset  of 
a  run).   Thus,  a  considerable  amount  of  motion  can  occur  during 
each  one-frame  exposure.   The  deterioration  in  performance  is 
thus  seen  to  be  due  to  the  fixation  time  required  at  each  point 
for  data  analysis. 

The  major  psychophysical  result  of  this  experiment  is  that 
dispersion  effects  (10-deg  dispersion)  have  been  shown  to  be 
significant  up  to  about  ten-frames  duration  (where  counting  dif- 
ficulty disappears) .   The  curve  of  percent  correct  counts  versus 
distance  at  7  =  10  frames  in  Figure  5.8  serves  to  define  a  "spa- 
cial  span  of  apprehension"  of  5  deg  for  letter  comparison. 

5.4  The  Problem  of  Recognition  in  Context 

Clearly,  what  we  are  able  to  recognize  from  any  display 
depends  upon  the  context  (rest  of  the  display)  as  well  as  the 
particular  recognition  task  under  consideration.   Sprinkled 
through  the  literature  are  numerous  examples  of  the  influence 
of  context  on  task  performance.   Contextual  relations  have  been 
shown  to  operate  in  rather  complicated  ways  in  short-term  visual 
memory  (13) .   The  error-versus-display-position  curves  for  linear 
displays  of  letters  reported  by  Averbach  and  Coriell  (15)  indi- 
cate a  simpler  problem  of  recognition  in  context  as  do  the  error- 
versus-position  curves  in  Appendixes  A  and  C.   The  curves  in 
Figure  5.1  strongly  indicate  that  letter  separation  (size  con- 
text) may  be  optimized  for  maximum  report  at  given  exposure 
durations.   In  this  section  a  general  hypothesis  is  suggested 
to  explain  various  contextual  problems. 

To  pursue  this  problem  further,  we  shall  analyze  the  re- 
sults of  Experiments  2  and  3  from  a  different  point  of  view 
(see  Fig.  5.10).   This  figure  compares  success  with  best-fit 
grading  in  Experiment  2  with  letter  recognition  in  Experiment  3 
for  individual  element  positions.   It  should  be  recalled  that 
patterns  consist  of  related  elements  (strongly  related  elements) , 
while  letter  recognition  involves  the  recall  of  unrelated  items. 
The  data  in  Figure  5.10  have  been  averaged  over  all  subjects 
and  all  durations.   Percentages  refer  to  the  results  of  Experi- 
ments 2  and  3,  and  because  the  average  performance  was  different 
in  these  two  experiments,  the  figures  must  be  carefully  inter- 
preted . 

Beginning  with  pattern  (H) ,  we  see  that  the  center  element 
is  reported  correctly  more  often  in  letter  recall  than  pattern 
recognition  (by  approximately  2  to  1) ,  while  the  reverse  is 
true  of  the  center  element  of  pattern  (J) .   At  this  point  we 
shall  state  a  general  hypothesis: 
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Experiments    2    and    Z 
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Proximity    and   containment    enhance    the    report    success    of  re- 
lated   items    while    reducing    report    success    of  unrelated    items. 

Pattern  (1)  further  illustrates  this  point,  as  does  pattern  (2) 
with  respect  to  the  two  element  pairs,  and  pattern  (8)  with  re- 
spect to  the  lineal  segments  of  the  array. 

Proximity  to  the  edges  or  borders  enhances  recognition  of 
pattern  elements  but  offers  little  help  to  letter  recall  [see 
patterns  (2)  and  (8)].   Furthermore,  grouping  of  unrelated  items 
does  not  enhance  letter  recall  but  definitely  aids  pattern  ele- 
ment recall. 

It  is  clear  from  virtually  all  of  the  letter-recall  pat- 
terns that  subjects  read  letters  (or  scan  in  search  of  letters) 
mainly  from  left  to  right  and  to  a  lesser  extent  from  top  to 
bottom.   The  same  statement  is  not  necessarily  true  for  pattern 
items  [see  (B) ,  (H) ,  and  so  on] . 

In  addition  to  the  convenient  discussion  of  the  context 
problem  offered  by  the  data  in  Figure  5.10,  the  same  general 
concepts  are  completely  applicable  to  letter-recall  data  from 
Experiment  5  and  Experiments  C.l  through  C.4,  and  also  applicable 
to  the  data  presented  by  Averbach  and  Coriell  (15) . 

The  problem  of  recognition  in  context  is  not  completely 
solved  with  the  above  considerations.  However,  they  do  help 
demonstrate  a  significant  aspect  of  visual  pattern  recognition. 
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6.  CONCLUSIONS 

In  this  section  various  conclusions  reached  in  the  body  of 
the  text  are  summarized  and  future  work  directly  related  to  this 
research  is  discussed. 

6. 1  Summary  of  Basic  Pattern-Recognition  Results 

This  thesis  is  concerned  with  the  recognition  of  visual  pat- 
terns of  considerable  size  (10  deg)  in  one-glance  exposures  last- 
ing from  about  60  msec  to  3  sec.   The  experimental  technique  se- 
lected for  this  investigation  involved  the  use  of  motion  picture 
stimulus  displays  and  psychophysical  reports  by  the  subject  either 
written  or  verbal.   Two  types  of  spacial  distribution  were  used 
to  accentuate  operational  principles  in  recognition:  one  involved 
English  letter  displays  (unrelated  elements) ;  the  other  involved 
patterns  (related  elements).   And  two  types  of  report  were  used: 
total  report  to  measure  span  of  immediate  memory,  and  a  sampled 
report  to  illustrate  the  role  of  short-term  memory.   The  stimulus 
ensemble  was  designed  to  be  large  enough  to  provide  for  separa- 
tion of  pattern  recognition  and  pattern  registration.   To  imple- 
ment this  separation,  a  best-fit  grading  technique  was  employed 
in  pattern-recognition  experiments  to  provide  a  basis  for  compari- 
son of  best-fit  and  absolute  registration  grades.   The  gross 
features  of  eye  motion  (in  the  horizontal  direction)  were  measured 
in  connection  with  lineal  visual  patterns  of  9  deg  horizontal  ex- 
tent.  Effects  of  pattern  source  dispersion  were  also  demonstrated 
psychophysically .   In  addition,  the  problem  of  recognition  in  con- 
text for  related  and  unrelated  elements  was  explored.   A  summary 
of  conclusions  follows: 

1.  The  motion  picture  technique  for  the  presentation  of 
short-duration  visual  stimuli  with  a  wide  variety  of  preexposure 
and  postexposure  fields,  dynamic  light  intensity  range  of  10  db , 
and  provision  for  image  size  variation  has  been  demonstrated  suc- 
cessfully.  The  ease  with  which  completely  preprogrammed  experi- 
ments may  be  conducted  further  enhances  the  attractiveness  of  this 
technique . 

2.  Completely  subjective  classification  of  five-  and  ten- 
element  patterns  from  a  9  x  12  matrix  into  random  and  structured 
groups  provides  a  basis  for  performance  prediction  for  both  total- 
report  experiments  and  short-term  memory  experiments.   In  general, 
there  is  less  difference  in  total-report  performance  between 
random  and  structured  (5) -patterns  than  (10) -patterns  for  short- 
duration  exposures.   The  single  dominant  feature  in  performance 
between  random  and  structured  patterns  of  both  sets  is  the  sharp 
upward  slope  in  performance  that  generally  occurs  after  two 
frames  of  exposure.   This  is  the  shortest  duration  for  which 
voluntary  eye  motion  can  occur.   Thus,  it  is  concluded  that  eye 
motion  is  essential  to  the  recognition  (for  reproduction)  of  pat- 
terns from  a  9  X  12  matrix  ensemble  subtending  angles  up  to 

10  deg  to  the  observer. 
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3.  An  upper  limit  of  about  sixteen  bits  of  information 
can  be 'transmitted  in  a  single  glance  (of  three  seconds  dura- 
tion) from  the  (10) -pattern  source;  about  nine  bits  can  be 
transmitted  per  exposure  from  a  (5) -pattern  source.   The  number 
of  elements  that  saturate  the  span  of  immediate  memory  varies 
by  more  than  3  to  1  between  random  and  structured  (10) -patterns , 
and  1.5  to  1  with  (5) -patterns . 

4.  The  short-term  memory  connected  with  visual  pattern 
recognition  has  been  demonstrated  to  store  more  information 
than  is  available  through  total  report.   This  storage  capacity, 
which  is  dependent  upon  the  nature  of  the  patterns,  is  at  least 
2  5  times  the  information  available  in  total  report.   The  decay 
of  short-term  memory  is  a  function  of  the  pattern  type.   Random 
patterns  decay  quickly  (less  than  five  frames) ,  while  structured 
patterns  are  characterized  by  performance  higher  than  the  total- 
report  level  for  at  least  1  sec.   Furthermore,  the  compression 
of  performance  difference  between  random  and  structured  patterns 
at  very  short  delays  indicates  that  the  short-term  memory  acts 
as  an  eidetic  storage  for  short  lengths  of  time. 

5    Total  report  from  unknown  arrays  of  English  letters 
subtending  angles  of  10  deg  to  the  subject  is  shown  to  be  virtu- 
ally independent  of  the  number  of  letters  in  the  array  (for 
n  =  5  and  n  =  10)  for  exposures  of  one  and  two  frames  (62  and 
125  msec) .   For  exposures  between  two  and  twenty  frames  (125  msec 
to  1.25  sec)  lower  letter  density  five  letters)  results  in  im- 
proved performance  (by  about  one  letter) .   This  fact  is  further 
substantiated  by  the  results  of  experiments  with  known  arrays 
of  ten  letters  when  closer  spacing  deteriorates  performance  by 
as  much  as  one  letter  (in  four)  for  exposure  durations  between 
two  and  twenty  frames.    The  effect  of  unknown  letter  positions 
within  a  9  X  12  matrix  is  to  reduce  letter  recall  by  an  average 
of  about  0.8  letters  for  exposure  durations  up  to  twenty  frames 
(1.25  sec).   The  long  exposure,  unknown  array  letter-recall 
results  indicate  that  the  number  of  letters  reported  is  inde- 
pendent of  the  letter  array.   In  contrast,  when  the  same  letter 
positions  are  used  to  form  a  matrix  pattern,  the  greatest  dif- 
ference in  performance  occurs  for  long-duration  exposures.   The 
maximum  number  of  letters  that  can  be  reported  in  one  glance 
is  a  mild  function  of  the  letter-array  dispersion.   The  closer 
the  letters,  rhe  more  will  be  reported. 

6.  Voluntary  eye  motion  (horizontal)  in  connection  with 
psychophysical  experimentation  with  lineal  patterns  does  not 
occur  until  at  least  125  msec  after  the  onset  of  the  stimulus 
flash.   The  latency  of  such  gross  motions  (greater  than  1/2  deg) 
is  a  function  of  flash  energy.   Furthermore,  postexposure  mo- 
tion is  a  function  of  the  stimulus  material  in  the  exposure. 
Saccadic  postexposure  motion  occurs  for  stimuli  with  numerals, 
while  slow  scanning  characterizes  the  postexposure  motion  that 
occurs  with  pattern  stimuli. 

7.  It  has  been  demonstrated  that  proximity  and  contain- 
ment enhance  performance  in  the  recall  of  related  items  (pat- 
terns) ;  these  same  features  interfere  with  the  recall  of 
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related  items  (patterns) ;  these  same  features  interfere  with  the 
recall  of  unrelated  items — that  is,  zero-gram  English  letters. 
This  principle,  operative  in  a  variety  of  situations,  is  consid- 
ered to  be  a  general  performance  characteristic. 

8.   The  naive  notion  that  performance  always  improves  with 
increased  exposure  duration  has  been  demonstrated  to  be  false. 
Certain  stimulus  conditions  result  in  nonmonotonically  decreasing 
error  for  moderate  exposure  durations.   Such  conditions  may  be 
related  to  eye  motion  interactions,  light-versus-time  considera- 
tions, and  other  details  of  presentation. 

6.2  A  Line  of  Research 

The  approach  to  the  problem  of  one-glance  pattern  recognition 
taken  here  differs  from  other  studies  in  two  respects.   First, 
patterns  physically  larger  than  those  ordinarily  used  have  com- 
prised the  majority  of  a  stimulus  material.   Second,  the  9  x  12 
pattern  ensemble,  which  is  used  almost  exclusively,  is  bigger  than 
source  ensembles  discussed  in  the  literature.   These  differences 
were  incorporated  at  the  outset  in  an  attempt  to  come  closer  to 
the  normal  visual  infomnation-transmission  problem  of  practical 
interest.   The  major  visual  problem  is  not  the  one-glance  problem; 
rather,  it  is  the  two-,  three-,  four-glance  problem  at  informa- 
tion sources  of  even  greater  extent  than  those  used  here.   The 
transfer  of  information  from  glance  to  glance  is  a  very  signifi- 
cant attribute  of  visual  performance.   Having  established  some  of 
the  ground  rules  for  the  one-glance  problem  with  dispersed  pat- 
terns, one  should  now  pursue  the  problem  of  information  trans- 
mission between  glances. 

A  direct  empirical  approach  employing  a  combination  of  psy- 
chophysical and  objective  measurements,  such  as  eye  motion  measure- 
ments, is  adequate  for  the  problem  of  multiple-glance  recognition. 
Studies  based  essentially  on  sampling  techniques  in  which  the 
subject  is  allowed  as  many  opportunities  as  he  desires  to  re- 
assess the  stimulus  information  appear  quite  feasible;  they  rep- 
resent very  fruitful  areas  for  continued  work  aimed  at  understand- 
ing, at  least  at  the  psychophysical  level,  the  operation  of  the 
visual  modality.   The  major  problem  in  all  this  work  is  the  de- 
sign of  experiments.   One  can  often  state  what  he  is  interested 
in  measuring  much  better  than  he  can  measure   it.   Most  of  the 
interesting  things  to  measure  require  detailed  and  ingenious  ex- 
perimentation.  And  this  ingenuity  is  most  conspicuous  by  its 
absence  from  the  literature. 

The  role  of  short-term  memory  in  vision  is  increasingly  im- 
portant in  the  study  of  the  transfer  of  information  from  one  to 
another  glance.   Even  the  simple  problem  of  defining  what  time- 
duration  constitutes  a  glance — that  is,  a  discrete  information 
intake  interval--is  a  significant  unanswered  question.   These 
problems  have  not  yet  been  rigorously  approached;  they  must  be 
approached  if  we  are  to  try  to  achieve  an  understanding  of  human 
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utilization  of  visual  information.   Whereas  many  of  the  possibili- 
ties and  variations  of  tachistoscopic  presentation  have  been  thor- 
oughly investigated  and  in  large  measure  have  contributed  to  our 
present  understanding  of  information  in  vision,  sampling  tech- 
niques have  not  been  subject  to  the  same  degree  of  experimenta- 
tion diversity.   Appropriately  designed  sampling  techniques  will 
allow  us  to  infer  a  great  deal  from  direct  empirical  psychophysi- 
cal measurement  about  the  process  of  information  utilization  and 
processing  other  than  through  the  intermediary  of  a  second  satu- 
rated response  system.   The  major  problem  in  these  investigations 
is  response  time.   Clearly,  the  human  can  take  in  information 
much  faster  than  he  can  use  it~at  least  when  he  is  required  to 
utilize  it  through  behavior  manifested  by  a  response  system  dif- 
ferent from  the  receiving  modality. 

It  should  not  be  necessary  to  spell  out  here  the  specific 
experiments  that  should  be  conducted  to  lend  more  meaning  to  this 
work,  to  relate  it  more  closely  to  published  studies,  and  to  pro- 
vide more  significant  or  more  general  answers  regarding  the  opera- 
tion of  the  visual  modality.   In  several  places  in  the  text,  ques- 
tions have  been  raised  to  which  answers  must  exist.   It  is  more 
important  to  relay  the  impression  to  the  reader  that,  after  con- 
siderable psychophysical  experimentation  in  vision,  the  author's 
considered  technical  opinion  is  that  this  direct  empirical  psycho- 
physical approach  has  not  been  fully  exploited  in  visual  informa- 
tion-transmission investigations.   Quite  clearly,  it  has  not  been 
completely  exploited  in  this  work  either.   While  considerable     I 
interest  and  confidence  are  placed  in  other  objective  measures 
of  performance,  it  is  really  behavioral  or  psychophysical  measures 
of  performance  that  determine  the  human's  reaction  to  his  environ- 
ment . 


104 


Appendix  A 

A  VISUAL  AND  A  KINESTHETIC -TACTILE  EXPERIMENT 
IN  PATTERN  RECOGNITION* 

In  sensory-aids  research  one  is  often  concerned  with  a 
human  subject's  performance  in  a  task  for  which  the  normal  in- 
put sensory  modality  is  replaced  by  an  alternative  modality. 
In  addition  to  inherent  differences  in  the  information  intake 
and  processing  capabilities  of  two  sensory  systems,  there  are 
in  each  system  purely  mechanical  effects  that  significantly 
modify  performance  and  thus  complicate  the  problem  of  sensory 
replacement.   The  experiment  reported  here  compares  human  per- 
formance in  a  simple  pattern-recognition  task  with  the  visual 
and  the  kinesthetic-tactile  sensory  modalities.   Such  an  experi- 
ment illustrates  both  the  inherent  information-processing  ca- 
pabilities and  the  mechanical  factors  that  influence  perform- 
ance (1)  . 

A.  1.  A  Visual  Experiment  in  Pattern  Recognition 

In  the  visual  part  of  the  experiment  twenty-one  subjects 
were  shown  a  sequence  of  thirteen  patterns,  each  consisting  of 
a  horizontal  row  of  six  black  or  white  squares.   Patterns  were 
exposed  with  white  signal  boxes  on  a  black  background  for  six 
discrete  time  durations  ranging  from  30  to  500  msec.   Subjects 
responded  by  placing  X's  on  the  answer  sheet  in  each  position 
where  a  white  element  appeared.   The  ambient  light  level  was 
reasonably  constant,  and  the  stimulus  intensity  well  above 
threshold.   Figure  A.l  shows  sample  patterns. 

Performance  in  this  task  was  good.   An  over-all  error 
rate  of  2.55  percent  was  noted  for  all  patterns  and  all  times. 
(An  error  was  arbitrarily  defined  as  any  square  mismarked 
either  through  omission  of  a  correct  response  or  insertion  of 
an  incorrect  response.)   The  percentage  of  error  versus  exposure- 
time  duration  for  all  patterns  and  for  the  test  group  (three 
white  squares  out  of  six)  is  shown  in  Figure  A. 2.   Figure  A. 3 
shows  the  relative  number  of  errors  made  on  each  of  the  thirteen 
test  patterns.   The  ordinate  scale  is  normalized  to  the  number 
of  errors  on  the  pattern  with  the  fewest  errors.   Figure  A. 4 
shows  the  distribution  of  errors  with  respect  to  the  stimulus 
positions.   The  stimulus  patterns  were  so  arranged  that  subjects 
would  make  approximately  the  same  number  of  responses  for  each 
position  for  the  whole  experiment. 

*Th.e   author   gratefully    acknowledges    the    contributions    of 
Dr.    J.     C.    Bliss    in    the    work    on    the    kinesthetic-tactile    mo- 
dality  described    in    this    appendix . 
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Figure   A.l.       Sample    Patterns    for    Visual    Experiment 
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The  most  interesting  feature  of  the  results   is  the  peak 
in  the  error-rate-versus-exposure-duration  curve  in  the  vicinity 
of  60-msec  exposure  time.   This  tendency  is  present  in  each  in- 
dividual pattern  (at  least  when  there  is  a  sufficient  number  of 
Srrors  to  iustify  this  statement) .   No  definite  explanation  is 
offered  for  this  phenomenon.   However,  the  author  has  concluded 

(through  introspection)  that  pattern  exposures  of  approximately 
60-msec  duration  produced  the  most  pronounced  afterimage. 
Furthermore,  it  is  more  difficult  to  stabilize  the  position  of 
the  afterimage  in  the  visual  field  for  exposures  of  this  dura- 
tion than  for  any  other  exposure  time  used  in  the  experiment. 

(This  peak  in  error  rate  was  not  noted  in  the  kinesthetic-tactile 

experiment.)  ,   .   ^       j.i. 

For  a  100-msec  exposure  of  patterns  from  the  test  group  the 
subjects  received  information  at  a  rate  of  less  than  30  bits/sec, 
and  their  response  was  essentially  errorless  (1.9  percent). _  The 
curve  in  Figure  A. 2  indicates  that  the  subjects  who  took  this 
test  were  capable  of  an  information  intake  of  approximately  9  0 
bits/sec  with  the  same  error  rate  for  much  shorter  exposure  times 
(30  msec).  (Not  all  subjects  respond  in  this  manner.   Some  made 
virtually  no  errors  during  the  whole  experiment.) 

Figure  A. 3  illustrates  how  the  errors  were  distributed  for 
the  patterns  presented.   Note  that  the  positions  of  the  white 
squares  in  the  pattern  are  indicated  by  "1."   Despite  the  fact 
that  a  pattern  of  two  white  squares  and  four  black  squares  might 
be  considered  informationally  equivalent  to  its  complement  (four 
white  squares  and  two  black  squares),  higher  error  rates  are    __ 
noted. in  patterns  in  which  the  subject's  response  is   four  X  s. 
In  the  three-out-of-six  response  patterns  the  situation  is  dif- 
ferent because  both  complementary  pairs  require  the  same  number 
of  responses.   Patterns  7  and  10  are  complements,  yet  the  error 
rate  for  10  is  three  times  higher.   Examination  of  the  patterns 
shows  that  the  three-in-a-row  response  pattern  of  7  is  probably 
much  simpler  to  encode  than  the  separated  response  pattern  of 
10    Patterns  8  and  11  are  also  complements/  the  same  error  rate 
and  general  characteristics  of  the  response  pattern  are  noted. 
This  phenomenon  supports  the  general  conclusion  that  informa-_ 
tionally  equivalent  tasks  are  not  always  psychophysically  equiva- 

'Referring  again  to  Figure  A. 4,  the  fact  that  fewer  errors 
are  shown  for  the  subjects  in  positions  1  and  6  is  in  general 
agreement  with  many  published  results.   The  preponderance  of  er- 
rors in  position  4,  despite  the  fact  that  in  general,  the  sub- 
jects' eyes  were  fixated  on  this  position,  is  more  difficult  to 
explain.   This  differs  from  results  published  by  Averbach  and 
Coriell  (2)  in  a  study  of  short-term  memory  in  vision.   They  re- 
port that  when  the  subject  is  able  to  assimilate  information 
from  a  linear  array  for  a  fixed  time  duration,  he  makes  the  few- 
est number  of  "recall"  errors  in  the  central  positions.   The  dif- 
ference is  explained  in  section  5.4. 
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A.  2,  Kinesthetic -Tactile  Experiment  in  Pattern  Recognition 

The  kinesthetic-tactile  experiment  consisted  of  simultane- 
ously moving  some  combination  of  the  subject's  fingers  with  an 
external  driving  mechanism.   Only  six  fingers  were  used:  the 
index,  middle,  and  fourth  fingers  of  each  hand.   The  various 
combinations  of  finger  movements  corresponded  to  the  thirteen 
black-and-white  1x6  matrix  patterns  used  in  the  visual  part 
of  the  experiment.   The  apparatus  consisted  of  eight  finger 
rests,  six  of  which  were  connected  and  could  be  moved  in  the 
vertical  direction  by  Sylphon  bellows  according  to  a  program 
punched  on  paper  tape.   The  movements  were  at  least  1/8  in. 
in  all  cases,  which  is  well  above  threshold  (3).   Figure  A. 5 
shows  the  apparatus  and  the  air  valve  which  used  punched-paper 
tape  as  the  slide.   A  shield  was  so  placed  that  the  subject 
could  not  see  his  hands  during  the  experiment.   On  it  there 
was  a  diagram  that  gave  the  number  labels  for  the  six  fingers 
which  were  numbered  1  through  6,  from  left  to  right.   Six  dis- 
crete time  durations,  during  which  air  pressure  was  on  the  bel- 
lows, covered  the  range  from  10  to  500  msec.   The  subject  re- 
sponded orally  by  indicating  the  numbers  of  the  fingers  that 
were  moved . 

The  combined  error  rate  for  all  times  and  all  patterns 
was  10.5  percent.   (An  error  is  defined  as  either  reporting  a 
finger  movement  that  did  not  occur  or  failing  to  report  a  finger 
movement.)   The  percentage  of  error  versus  exposure-time  dura- 
tion for  the  test  group  of  patterns  is  given  in  Figure  A. 6. 

Figure  A. 4  shows  the  distribution  of  errors  with  respect 
to  the  finger  stimulated.   This  distribution  can  be  explained 
if  one  assumes  that  most  errors  in  finger  localization  are 
made  between  adjacent  fingers  of  the  same  hand.   This  assump- 
tion was  checked  in  an  auxiliary  experiment  in  which  all  com- 
binations of  the  2-out-of-6  patterns  were  presented  to  two 
subjects.   Table  A.l  shows  the  confusion  matrix  obtained  for 
the  errors.   Thus,  the  relatively  low  error  rate  obtained  for 
fingers  3  and  4  (Figure  A. 4)  is  probably  due  to  the  fact  that 
they  are  on  different  hands,  and  the  low  rate  for  fingers  1  and 
6  probably  results  from  the  fact  that  these  were  the  "outside" 
fingers  in  the  experiment. 

Table  A.  1 

Stimulus -Response  Matrix  for  all  Combinations 
of  Two-Out-of-Six  Finger  Movements 
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Figure   A. 6.       Percentage    of   Error    vs    Exposure    Time    for 
Test   Patterns    in    the    Kinesthetic -Tactile    Experiment 
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A. 3  shows  the  relative  number  of  errors  made  on  each 
teen  patterns.   The  percentage  of  error  increased 
th  the  number  of  fingers  stimulated.   Complementary 
th  unequal  numbers  of  fingers  stimulated  apparently 
icantly  different  error  rates.   Patterns  in  which 
ted  fingers  were  adjacent — for  example,  111000 — re- 
much  lower  error  rate  than  patterns  in  which  alter- 
s  were  stimulated — for  example,  010101. 


A.  3.  Comparison  of  Visual  and  Kinesthetic -Tactile  Results 

Because  the  stimulus  intensities  for  each  modality  were  well 
above  threshold  intensities  (although  no  attempt  was  made  to 
equate  the  stimulus  energy  for  each  modality) ,  it  can  be  con- 
cluded that  all  subjects  perform  much  better  in  the  task  when 
visual  information  intake  is  used.   Error  rates  are  an  order  of 
magnitude  higher  for  the  kinesthetic-tactile  experiment. 

The  assumption  that  complementary  patterns  are  informa- 
tionally  equivalent  is  not  upheld  by  the  results  for  visual  or 
kinesthetic-tactile  stimulations.   However,  the  reasons  are 
different.   When  the  visual  observer  is  asked  to  note  and  re- 
port the  positions  of  the  white  squares,  he  does  not  appear  to 
encode  the  pattern  as  a  whole,  but  rather  to  "measure"  the  dis- 
tance between  stimulus  squares.   This  results  in  higher  error 
rates  on  the  complementary  patterns  with  the  greater  distance 
between  response  positions.   (See  patterns  7  and  10,  Fig.  A. 3.) 

With  tactile  stimulation,  complementary  excitation  (move- 
ment-no movement)  appears  to  be  even  less  useful  as  an  encoding 
tool  for  the  subject.   This  can  be  seen  from  the  marked  increase 
in  error  rate  as  one  goes  from  one  to  four  stimuli  out  of  six 
(Figure  A.3) . 
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In  kinesthetic-tactile  stimulation  the  ability  to  dichoto- 
mize the  stimulus  because  of  the  use  of  two  hands  results  in 
position  errors  for  the  two  modalities  that  are  significantly 
different  in  positions  3  and  4.   In  the  visual  display  the  cen- 
ter positions  are  most  often  confused  because  the  subject  pre- 
sumably measures  distance  from  the  end.   This  conclusion  is  borne 
out  in  both  the  position-error  curve  (Fig.  A. 4)  and  the  pattern- 
error  curve  (Fig.  A. 3). 

A  simple  model  of  visual  information  transmission  which  as- 
sumes that  performance  should  continue  to  improve  as  the  stimulus 
duration  is  increased  (because  of  greater  stimulus  energy _ at 
constant  intensity)  is  not  consistent  with  data  for  the  visual 
sense.   The  sudden  increase  in  error  rate  when  60-msec  exposure 
times  are  used,  which  probably  results  from  some  "mechanical" 
aspect  of  the  visual  process,  is  not  present  in  the  tactile  ex- 
periment.  The  error  characteristic  in  Figure  A. 2  is  quite  simi- 
lar to  the  brightness-judgment-versus-duration  curves  for  con- 
stant brightness  pulses  which  manifest  the  Broca-Sulzer  phenome- 
non (4,  5).   Perhaps  the  higher  apparent  brightness  of  the  60- 
msec  exposure  produces  the  more  pronounced  afterimage  observed 
at  this  duration. 

The  results  and  conclusions  presented  in  this  report  are 
preliminary.   No  special  significance  is  attached  to  the  nu- 
merical results;  they  are  considered  to  be  illustrative. 
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Appendix  B 
COMPILATION  OF  EXPERIMENTAL  DATA 

Data  are  presented  in  the  order  in  which  the  various  experi- 
ments are  discussed  in  the  text. 

Experiment  1 

Table  B.l  indicates  the  random-structured  grouping  made  by 
each  of  the  twenty  subjects. 

Experiment  2 

Tables  B.2  and  B.3  summarize  the  best-fit  and  absolute  regis- 
tration grades  for  each  of  seven  subjects.   Blank  spaces  indicate 
discarded  data;  a  hyphen  indicates  that  the  subject  missed  the  ex- 
posure because  of  inattention  and  the  like. 

Experiments  3  and  3A 

Table  B.4  indicates  the  number  of  letters  reported  correctly 
by  each  of  six  subjects.   Data  are  compiled  by  pattern,  with  in- 
creased duration  for  each  pattern  running  from  top  to  bottom. 
Durations  used  were  1,  2,  5,  10,  20,  and  50  frames. 

The  data  in  the  right-hand  column  are  from  Experiment  3A. 
Scores  with  redundant  letter  groups  are  underlined.   The  other 
scores  are  for  the  same  letter  groups  as  those  used  in  the  left- 
hand  column.   This  group  of  figures  is  included  to  indicate  the 
repeatability  of  the  experiment. 

Experiment  4 

Table  B.5  presents  a  compilation  of  experimental  data  for 
the  three  subjects  tested  in  Experiment  4.   All  pattern  and  sample 
pair  exposures  lasted  ten  frames;  the  duration  data  in  Table  B.5 
refer  to  the  delay  between  pattern  and  sample  pair  exposures. 
The  number  of  pairs  correctly  grades  (out  of  ten)  are  given  in 
the  last  three  columns. 

Experiment  5 

Experimental  data  for  six  subjects  with  two  lineal  arrays 
(A  and  B)  of  letters  are  shown  in  Table  B.6.   The  two  figures  at 
each  duration  are  the  number  of  letters  reported  from  two  differ- 
ent exposures  with  different  letters. 
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Table  B.  1 
Experiment  1 — Data 
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5  SSSSSSSSSSSRRRRSRSSS 

6  RRSRRRRSRSRSRSRSRRRR 

7  SSSSSSRSSSSSRSSSRSRS 

8  SSSSSSSSSSSSSSSSSSSS 

9  SSSSSSSSSSSSSSSSSSSS 

10  RRRRRRRRRRRRRRRRSRRR 
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Experiment  2  subject, 
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Table  B.4 
Experiments  3  and  3A — Data 


Experiment 

3 

Experiment  3A 

Run 

Number 

'  Correct 

iy  S'mZ?^ 

'ect 

Number 

(1,     2.  3) 

Totals 

Practice 

Pattern 

DJK 

RJK 

LCM 

JJJ 

CEK 

yi^^ip 

(6) 

RJM 

LCM      JJJ 

6 

H 

1 

3 

2 

1 

4 

4 

15 

19 

H 

4 

4 

3 

4 

3 

5 

23 

28 

H 

2 

5 

2 

3 

2 

4 

18 

14 

H 

2 

5 

2 

3 

3 

5 

20 

42 

H 

5 

4 

4 

5 

4 

5 

27 

5 

4     5 

31 

H 

5 

5 

5 

5 

5 

5 

30 

9 

J 

0 

3 

1 

2 

— 

3 

9 

4 

J 

1 

3 

1 

2 

4 

2 

13 

3^ 

3     2 

26 

J 

3 

4 

- 

- 

- 

5 

12 

36 

J 

5 

5 

3 

4 

5 

5 

27 

33 

J 

5 

5 

3 

5 

5 

5 

28 

5 

5     5 

22 

J 

5 

5 

5 

4 

5 

5 

29 

15 

B 

1 

2 

1 

2 

2 

3 

11 

30 

B 

2 

3 

- 

2 

2 

3 

12 

23 

B 

3 

5 

2 

2 

4 

5 

21 

5 

B 

3 

5 

4 

4 

5 

5 

26 

40 

B 

5 

5 

5 

5 

5 

5 

30 

5 

5     5 

18 

B 

5 

5 

5 

5 

5 

5 

30 

35 

(1) 

1 

1 

1 

0 

1 

3 

7 

24 

(1) 

3 

5 

2 

3 

3 

4 

20 

12 

(1) 

3 

5 

3 

3 

- 

2 

14 

4 

2     3^ 

16 

(1) 

3 

5 

3 

4 

4 

4 

23 

44 

(1) 

7 

6 

3 

4 

5 

7 

32 

7 

4     5 

7 

(1) 

6 

9 

5 

4 

5 

8 

37 

7 

5     6^ 

43 

(2) 

2 

2 

2 

3 

- 

3 

12 

3 

1     2 

39 

(2) 

1 

2 

3 

2 

2 

4 

14 

21 

(2) 

2 

3 

2 

2 

3 

4 

16 

45 

(2) 

2 

4 

3 

3 

3 

5 

20 

4 

3     4 

8 

(2) 

4 

5 

4 

5 

5 

5 

28 

13 

(2) 

6 

4 

6 

3 

4 

5 

28 

20 

(6) 

- 

3 

0 

— 

3 

3 

9 

38 

(6) 

1 

3 

1 

1 

4 

3 

13 

27 

(6) 

3 

3 

- 

- 

2 

3 

11 

10 

(6) 

4 

5 

3 

3 

2 

- 

17 

4 

3     3 

17 

(6) 

1 

5 

4 

4 

5 

4 

22 

5 

4     4 

34 

(6) 

7 

6 

5 

4 

7 

9 

38 

32 

(8) 

1 

3 

2 

2 

3 

4 

15 

29 

(8) 

1 

2 

1 

3 

3 

4 

14 

37 

(8) 

3 

4 

3 

2 

3 

4 

19 

41 

(8) 

2 

3 

3 

3 

2 

4 

17 

3 

3     5 

11 

(8) 

4 

6 

5 

5 

4 

7 

31 

25 

(8) 

6 

7 

5 

5 

8 

6 

37 
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Table  B.5 
Experiment  4 Data 


Delay 

Subject 

Pattern 

Duration 

RJM 

LCM 

AMS 

F 

1 

(9)* 

(7) 

(8) 

F 

10 

(9) 

(7) 

(7) 

F 

20 

(9) 

(8) 

(8) 

B 

1 

(9) 

(9) 

(8) 

B 

2 

(9) 

(8) 

(7) 

B 

5 

(10) 

(6) 

(9) 

B 

10 

(10) 

(7) 

(5) 

B 

20 

(8) 

(5) 

(8) 

J 

1 

(10) 

(10) 

(10) 

J 

2 

(10) 

(10) 

(10) 

J 

5 

(9) 

(8) 

(8) 

J 

10 

(10) 

(10) 

(10) 

J 

20 

(10) 

(10) 

(10) 

6 

1 

(6) 

(7) 

(5) 

6 

2 

(6) 

(3) 

(6) 

6 

5 

(7) 

(2) 

(5) 

6 

10 

(4) 

(5) 

(3) 

6 

20 

(4) 

(1) 

(5) 

8 

1 

(9) 

(7) 

(7) 

8 

2 

(9) 

(7) 

(8) 

8 

5 

(8) 

(7) 

(9) 

8 

10 

(8) 

(9) 

(9) 

8 

20 

(9) 

(7) 

(8) 

3 

1 

(6) 

(5) 

(6/9) 

3 

10 

(8) 

(9) 

(7) 

3 

20 

(5) 

(6) 

(7) 

10 

1 

(8) 

(4) 

(6) 

10 

10 

(7) 

(5) 

(4) 

10 

20 

(6) 

(6) 

(3) 

*Number  of  correctly  related  samples  (out  of  ten) 
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Table  B.6 
Experiment  5 Data 


Run   No. 

Duration 

RJM 

Experiment 

LCM      JJJ 

5A 

JJ 

i?f/F 

MF 

Six    Subject 
Average 
Letter / 
Exposure 

7 
14 

(1) 

5 
4 

^ 

2 

2 
2 

2 

4 

2 
2 

2.8 

5 
12 

(2) 

5 
5 

i 

4 

3 
2 

2 
3 

4 
4 

2 
3 

3.2 

<   4 
<D   11 

(5) 

5 
5 

2 
2 

3 
2 

3 
3 

5 
4 

3 

4 

3.4 

^    9 
&   " 

(U   8 
"   15 

(10) 
(20) 

6 

5 

5 
5 

2 

4 

5 
3 

3 
3 

5 
3 

0 
4 

5 
5 

6 
6 

7 
5 

5 
5 

5 
5 

4,0 
4.8 

6 
10 

(50) 

6 
7 

6 
4 

5 
5 

7 
5 

6 
10 

10 
9 

6.6 

Exper 

iment 

5B 

7 
14 

(1) 

5 
4 

4 

1 

3 
3 

1 
2 

1 
1 

1 
4 

2.5 

5 
12 

(2) 

5 
5 

2 

3 

1 
3 

4 
2 

5 

4 

5 
3 

3.5 

m   4 
S  11 

(5) 

5 
5 

4 
3 

3 

4 
3 

5 
4 

4 
5 

4.1 

(U   9 
&  13 

(10) 

5 
5 

3 
2 

4 
2 

4 
5 

4 
7 

5 
3 

4.1 

^   8 
15 

(20) 

5 
5 

5 
5 

5 
5 

5 

5 

6 
5 

2 
5 

4.8 

6 
10 

(50) 

6 

5 

4 
6 

5 
5 

6 
5 

5 
7 

3 
5 

5.2 
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Experiment  6 

Table  B.7  is  a  compilation  of  experimental  data  for  the 
ten  subjects.   The  upper  row  of  figures  for  each  duration- 
distance  value  is  the  number  of  counts  reported  for  the  high- 
count  run.   The  lower  row  is  from  the  low-count  run. 

Experiments  CI — C4 

Data  on  which  the  results  of  experiments  described  in 
Appendix  C  are  based  are  recorded  in  Tables  B.8,  B.9,  and  B.IO. 
The  experimental  data  refer  to  the  number  of  errors  made  by  the 
subjects  as  a  function  of  position  in  the  1x6  matrix  and  ex- 
posure duration.   Data  for  Experiment  C-3  are  not  tabulated. 
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Table  B.7 
Experiment  6 Data 


Run 
Num- 
ber 

Dis- 
tance 

RJM 

LCM 

JJ 

JB 

WJM'^ 

yF(; 

OT 

JJJ 

f/5S 

JGB 

(10) 
To- 
tals 

Percent 
Average/ 
Run 

4 
/  8 

(1) 

2 
0 

0 
2 

3 
0 

0 
2 

0 

1 

0 
0 

0 
0 

0 
1 

0 
2 

4 
3 

(20) 

10 

I  24 

,30 

(2) 

2 

1 

0 
0 

3 
0 

1 
1 

1 
0 

0 
0 

0 
0 

2 
2 

1 
0 

4 
2 

(20) 

10 

'  1  6 

"   3 

(5) 

2 

1 

0 
0 

0 
2 

0 
0 

1 

0 

0 
0 

0 
0 

1 
0 

2 

1 

2 

0 

(12) 

6 

^1  20 

27 

(10) 

1 
0 

0 
0 

1 
1 

0 
0 

0 
0 

0 
0 

0 
0 

1 
0 

0 
0 

1 
0 

(5) 

2.5 

26 
(  1^ 

(1) 

6 
2 

3 
2 

5 
2 

4 

1 

2 
0 

3 

1 

5 
0 

4 

1 

4 
2 

4 
5 

(56) 

28 

10 
-   5 

(2) 

3 
3 

5 
3 

4 
2 

3 

1 

1 
0 

0 
0 

0 

1 

3 
2 

4 

1 

4 
4 

(43) 

21.5 

II  17 
&.  13 

(5) 

3 
2 

0 
4 

2 

3 

2 

1 

0 
0 

0 
0 

0 
0 

2 
2 

3 

4 

(28) 

15.5 

32 
21 

(10) 

2 
0 

3 
0 

3 
0 

1 
0 

1 

0 

0 
0 

0 
0 

1 
0 

6 
0 

0 
0 

(17) 

8.5 

25 

1 

(1) 

12 
5 

11 

4 

12 
4 

7 
2 

8 
3 

7 

1 

9 
2 

7 
3 

9 

4 

12 
6 

(128) 

64 

11 
^    29 

(2) 

12 
5 

11 
6 

11 
6 

8 
5 

7 
2 

12 
4 

10 
3 

8 
5 

9 
5 

13 
5 

(147) 

74 

11  31 

(5) 

9 
6 

10 
8 

7 
6 

5 
4 

3 
1 

6 
3 

4 
4 

7 
5 

8 
6 

6 
6 

(114) 

57 

'  \  9 

15 

(10) 

5 

4 

6 
4 

3 

1 

4 
2 

4 

1 

5 
2 

1 
0 

3 

1 

7 
4 

7 
2 

(66) 

33 

28 
16 

(1) 

11 
9 

11 
9 

11 
10 

10 
8 

11 
9 

12 
9 

10 
9 

11 
9 

11 
9 

11 
9 

(197) 

98 

2 

o  14 

(2) 

15 
5 

13 
5 

15 
5 

12 

4 

13 
5 

15 
5 

12 
5 

6 

14 
5 

13 
5 

(172) 

93 

''  22 

II  19 

(5) 

15 
5 

15 
6 

15 
6 

11 
3 

11 
5 

14 
5 

17 
4 

12 
5 

15 
5 

14 

5 

(189) 

96 

^   7 
23 

(10) 

9 
9 

10 
7 

8 
8 

6 

7 

7 
7 

10 
7 

6 
7 

6 
7 

11 
8 

5 
8 

(153) 

77 
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Table  B.8 


Experiment  C-1 — Data 


Error 

Versus 

Durat 

ion 

Sub  3 

eats 

Duration 

EG 

TN 

AS 

BD 

KK      . 

JOB 

OT 

ENS 

Totals 

No. 

1 

(30  msec) 

0 

2 

0 

0 

0 

0 

0 

1 

3 

No. 

2 

(50  msec) 

3 

2 

0 

0 

3 

0 

1 

3 

12 

No. 

3 

(60  msec) 

3 

3 

1 

6 

2 

0 

0 

2 

17 

No. 

4 

(100  msec) 

5 

2 

2 

3 

3 

4 

3 

2 

24 

No. 

5 

(200  msec) 

1 

0 

0 

2 

0 

0 

0 

0 

3 

No. 

6 

(500  msec) 

0 

6 

1 

5 

0 

4 

0 

0 

16 

TOTALS 

12 

15 

4 

16 

8 

8 

4 

8 

75 

a  X 

6 

X  6  X  13  = 

3744 

%  error 

-  75 

i/3744 

=  2 

.0% 

Error  Versus  Position 


Duration 

(Bottom) 
1 

2 

3 

4 

5 

crop; 

6 

No. 

1 

(30 

msec) 

0 

2 

1 

0 

0 

0 

No. 

2 

(50 

msec) 

0 

5 

3 

2 

2 

0 

No. 

3 

(60 

msec) 

2 

8 

5 

1 

1 

0 

No. 

4 

(100 

msec) 

4 

9 

6 

4 

1 

0 

No. 

5 

(200 

msec) 

0 

1 

1 

1 

0 

0 

No. 

6 

(500 

msec) 

2 

4 

4 

1 

3 

2 

TOTALS 

8 

29 

20 

9 

7 

2 
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Table  B.9 
Experiment  C-2 Data 


Error  Versus  Position  (9  Subjects) 

Duration  12      3      4      5      6  Totals 

30  msec  0      0      0      3      3      1  7 

50  msec  112      5      5      0  14 

60  msec  0      10      4      4      2  11 

100   msec  110  110  4 

2  00  msec  0     110      0      0  2 

500  msec  0      0      0      12      0  3 

TOTALS  2      4      3     14     15      3  41 


%  error  -  41/4212  =  0.96% 


Note:   Data  were  not  compiled  by  subject  when  the  experiments 
were  performed. 
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Table  B. 

10 

Experiment  C 

-4 

— 

Data 

Error 

Versus 

Posit 

ion 

(5 

Subj 

ects) 

Duration 

1 

2 

3 

4 

5 

6 

Totals 

30  msec 

0 

1 

2 

1 

3 

2 

9 

50  msec 

0 

1 

2 

2 

3 

1 

9 

60  msec 

0 

0 

1 

1 

3 

3 

8 

100  msec 

2 

4 

5 

2 

4 

3 

20 

200  msec 

0 

2 

2 

0 

1 

1 

6 

500  msec 

0 

0 

1 

2 

3 

2 

8 

TOTALS 

2 

8 

13 

8 

17 

12 

60 

%  error  =  60/2340  =  2.55% 


Note:   Data  were  not  compiled  by  subject  when  the  experiment 
was  performed. 
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Appendix  C 

SOME  FURTHER  EXPERIMENTS  IN  PATTERN  RECOGNITION 

FROM  LINEAR  ARRAYS 

Several  experiments  in  addition  to  those  described  in  Ap- 
pendix A  were  performed  with  the  1x6  array.   Appendix  A  experi- 
ments used  a  white-on-black  array — that  is,  a  black  surround  on 
which  white  squares  and  a  white  matrix  border  were  superimposed 
(see  Fig.  A.l).   Thus,  in  typical  tachistocope  presentations  a 
black  preexposure  field  (ambient  room  light)  is  followed  by  a  pre- 
dominantly black  exposure  and  black  postexposure  field.   This  form 
of  presentation  is  generally  less  conducive  to  persisting  after- 
images (from  which  information  may  be  drawn,  presumably)  than  the 
black  preexposure  field  followed  by  a  predominantly  white  expo- 
sure and  black  postexposure  field  (1) .   To  assess  the  extent  to 
which  afterimage  formation  may  cause  the  peak  in  error  rate  for 
60-msec  exposures  (see  Fig.  A. 2),  three  experiments  with  black- 
on-white  linear  1x6  arrays  were  performed.   Results  plus  a 
pattern-recognition  experiment  with  a  vertical  white-on-black 
1x6  array  are  the  subject  of  this  appendix. 

C.  1.  Vertical  Orientation  of  the  Linear  Array 

To  compare  performance  versus  duration  and  position  versus 
error-count  data  for  the  horizontal  orientation  of  a  white-on- 
black  1x6  array  (Figs.  A. 2  and  A. 4)  with  the  results  obtained 
for  vertical  orientation  of  the  array,  the  following  experiment 
was  performed.   Eight  subjects  were  exposed  to  the  pattern  array 
shown  in  Figure  C.l  for  durations  of  30,  50,  60,  100,  200,  and 
500  msec  and  instructed  to  mark  X's  in  the  positions  of  the  white 
squares  on  a  similar  matrix  appearing  on  the  answer  sheet.   Thir- 
teen different  patterns  were  exposed  at  each  duration.   A  standard 
projection  tachistoscope  was  used.   Experimental  conditions  were 
as  in  the  visual  experiments  described  in  Appendix  A. 

Figure  C.3  shows  the  percentage  of  error*  averaged  over  all 
subjects  as  a  function  of  exposure  duration  for  Experiment  C-1. 
The  over-all  percentage  of  error  was  2  percent,  slightly  less 
than  the  over-all  percentage  (2.55  percent)  measured  in  experi- 
ments with  a  horizontally  oriented  array  (see  Appendix  A) .   The 
same  peak  in  error  is  noted,  but  the  maximum  error  occurs  at 
100-msec  durations  rather  than  60-msec  durations.   Furthermore, 
the  error-versus-position  histogram  in  Figure  C.2  exhibits  the 
same  qualitative  behavior  as  do  the  error-versus-position  data 

*An    error    has    been   arhitrarity    defined   as    any    square   mismarked 
either    through   omission    of  a    correct    response    or    insertion    of 
an    incorrect    response    (the    same    criterion    used    in   Appendix   A). 
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BLACK 
SURROUND, 


note: 

black  and  white 

ARE  REVERSED  IN 
ACTUAL  PRESENTATION 


Figure    C.l.       Vertiaally    Oriented    1x6   Array 


TOP 


EYE 


LEVEL 


BOTTOM 


RELATIVE  NUMBER  OF  ERRORS 


Figure    C.2.       Relative    Error   vs   Position--Vertiaal    1^6   Array 
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in  Appendix  A  if  top  and  bottom  are  regarded  in  the  same  way  as 
left  and  right.   The  subjects  again  apparently  "measure"  distance 
from  the  boundary  to  deduce  the  pattern  structure. 

The  high  error  rate  at  500-msec  duration  is  considered  co- 
incidental. Of  the  sixteen  errors  recorded  at  this  duration, 
fifteen  were  made  by  three  of  the  eight  subjects.  Furthermore, 
eight  of  these  fifteen  errors  were  made  on  the  same  pattern  ex- 
posed at  the  same  time  to  only  the  same  three  subjects.  In  all 
probability,  some  exposure  artifact  such  as  a  defocused  or  mis- 
oriented  image  was  responsible  for  this  error. 

C.2.  Experiments  with  a  Black-on-White  1x6  Array* 

Three  experiments  were  conducted  with  a  black-on-white 
linear  1x6  array  (horizontally  oriented)  to  provide  additional 
data  on  the  unusual  error  performance  measured  with  the  white- 
on-black  array.   In  the  first  a  revised  version  of  the  array 
used  in  the  experiment  described  in  Appendix  A  was  employed. 
This  array  had  black  squares  on  a  white  surround.   The  changes 
in  light  level  from  dark  preexposure  field  to  bright  exposure 
back  to  dark  postexposure  field  would  be  expected  to  cause  pro- 
nounced negative  afterimages  for  short  duration  exposures. 

Nine  subjects  were  exposed  to  six  test  runs  (one  each  at 
durations  of  30,  50,  60,  lOQ,  200,  and  500  msec)  which  consisted 
of  thirteen  different  patterns  of  black  and  white  squares.   The 
only  difference  between  this  experiment  and  those  described  in 
Appendix  A  and  in  section  C.l  was  that  the  subjects  were  in- 
structed to  mark  X's  in  the  positions  of  the  black  squares  for 
each  exposure. 

The  over-all  percentage  of  error  was  0.96  percent,  a  fac- 
tor of  2.5  lower  than  for  the  comparable  experiment  in  Appen- 
dix A.   Figure  C.4  demonstrates  that  the  percent  error  versus 
duration  curve  again  exhibits  a  peak  between  50  and  60  msec. 
Figure  C.5  shows  the  distribution  of  errors  with  respect  to  po- 
sition for  Experiment  C-2.   As  expected,  this  curve  indicates 
an  almost  identical  distribution  of  errors  for  the  black-on- 
white  and  white-on-black  matrices.   The  similarity  in  shape  of 
the  error-versus-duration  curves  for  the  two  matrices,  with  the 
lower  error  rate  observed  for  the  black-on-white  matrix,  may 
be  attributed  to  two  factors: 

1.  The  mechanism  that  causes  the  peaking  is  the  same  for 
both  cases,  but  the  greater  "visibility,"  or  clarity,  of  the 
black-on-white  matrix  improves  performance. 

2.  The  unstable  negative  afterimage  created  by  the  50-to- 
60-msec  duration  exposures  is  not  responsible  for  the  peaking 
because  the  situation,  which  presumably  results  in  the  more  pro- 
nounced afterimage,  is  characterized  by  improved  performance. 

*The    author   gratefully    acknowledges    the    assistance    of  Mr.    R.    Spann 
in   performing    the    experiments    described    in    this    section. 
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To  evaluate  these  alternatives,  two  experiments  were  con- 
ducted. 

The  display  shown  in  Figure  C.6,  which  consists  of  an 
identical  1x6  matrix  with  three  numerals  in  various  com- 
binations of  the  six  entries,  was  exposed  exactly  as  in  Ex- 
periment C-2 .   Subjects  were  shown  the  sequence  of  exposures 
twice;  on  the  first  run  (Experiment  C-3)  they  were  required 
to  record  only  the  numerals  (in  any  order)  on  a  three-block 
answer  blank.   On  the  second  run  (Experiment  C-4) ,  they  were 
asked  to  record  the  numerals  in  their  correct  positions  in 
the  display.   Numerals  used  did  not  form  any  regular  sequence 
(like  123) ,  nor  was  the  same  numeral  used  twice  in  the  same 
display.*   The  error-versus-duration  curves  for  these  cases 
are  shown  in  Figure  C.4.   The  over-all  error  for  the  numeral 
report  case  was  about  2  percent;  for  the  numeral  plus  posi- 
tion report  case,  the  over-all  error  was  2.55  percent.   It 
should  be  noted  that  only  three  possible  errors  per  exposure 
were  considered  in  computing  the  error  curves  for  the  numeral 
report  case.   The  shapes  of  the  error-versus-duration  curves 
indicate  peak  errors  for  numeral  report  over  the  range  from 
50  to  100  msec,  whereas  the  error  for  numeral  plus  position 
report  peaks  only  at  100-msec  durations.   Thus,  from  these 
experiments,  we  cannot  draw  any  positive  conclusions  about 
the  phenomenon  that  causes 'this  peak.   However,  a  few  state- 
ments are  in  order.   Because  the  peaking  time  changes  for  the 
three  experiments,  peaking  is  not  caused  by  any  system  re- 
sponse to  special  light-versus-time  effects  such  as  the 
Broca-Sulzer  phenomenon  and  the  like.   The  peaking  most  prob- 
ably is  caused  by  the  mechanics  employed  by  the  subjects  when 
they  are  confronted  with  having  to  perform  the  three  differ- 
ent tasks.   The  difference  between  the  postexposure  eye  mo- 
tions measured  for  exposures  to  the  subject  matter  in  Experi- 
ments C-2  and  C-4  (see  section  5.2)  suggests  that  whatever 
phenomenon  is  responsible  for  this  behavior,  it  is  related 
to  voluntary  eye  motion.   Furthermore,  the  difference  in  er- 
ror position  for  the  two  cases  (see  Fig.  C.5)  indicates  that 
the  subject  has  trouble  with  the  far  right  entry  more  often 
when  making  a  numeral  plus  position  report. 
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*SubJ eats    were    given    this    information. 
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Appendix  D 

INFORMATIONAL  ASPECTS 

Since  1949,  the  year  of  Shannon's  work  on  the  quantitative 
measurement  and  manipulation  of  information  (1) ,  psychologists 
have  tried  to  use  statistical  measures  of  information  to  define 
information  transmission  by  the  human  through  his  various  sensory 
modalities.   Entire  symposia  have  been  devoted  to  the  marriage  of 
psychology  and  information  theory  (2) .   The  conceptual  and  analy- 
tic advantages  offered  by  regarding  the  human  as  an  information 
channel  characterized  by  a  channel  capacity  have  probably  been 
responsible  for  this  work. 

Several  attempts  have  been  made  to  measure  the  channel  ca- 
pacity of  the  human  visual  system*  with  respect  to  various  inputs. 
For  instance,  in  reading  English  text  (if  one  begins  from  Shan- 
non's figure  of  1.5  bits  per  letter  information  content),  the 
actual  amount  of  information  absorbed  or  perceived  is  measured 
in  tens  of  bits/sec  (3).   Quastler  (on  the  basis  of  several  ex- 
periments involving  various  sensory  modalities)  estimates  that 
the  highest  sustained  sensory  information  rates  are  about  25 
bits/sec.   This  is  vastly  lower  than  the  4.3  x  10°  bits/sec  de- 
rived by  Jacobsen  through  consideration  of  the  retinal  mosaic 
and  visual  acuity  alone  (4) . 

The  experiments  of  Miller,  Brunner ,  and  Postman  (5)  using 
lists  of  eight  letters  each,  whose  information  content  is  derived 
from  the  zerogram,  monogram,  and  so  on,  redundancies  of  ordinary 
English  indicate  information  processing  at  a  constant  rate  for 
this  source  of  approximately  10  bits/sec. 

It  is  much  more  difficult  to  describe  quantitatively  the  in- 
formation content  of  visual  patterns  from  an  arbitrary  source — 
even  from  the  finite  ensemble  described  in  section  2.2.   Subject 
to  certain  assumptions,  we  can,  however,  use  the  notion  of  sta- 
tistical information  measure  to  derive  an  upper  bound  to  informa- 
tion content. 

Consider  an  M  x  N   matrix  of  elements  (squares)  which  are 
filled  to  form  a  pattern.   Assume  that  n {n   <   MN)    elements  are 
filled.   The  number  of  possible  ways  A    in  which  we  may  select 
the  n    filled  boxes  (number  of  possible  patterns)  is  given  by 
Equation  (D. 1) . 

^  {MN)l  (D.l) 

nl  (MN    -   n)  I 

*It    should    be    noted   that    when    psychophysical    measurements   are 
used,    the    capacity    of   the    combination    of   the    visual    channel   and 
response    channel    is    usually   measured.       Furthermore,    most   measure- 
ments   of   this    type   are    merely    intended    to    measure    information 
transmission   for   a   given    input    set    rather    than    channel    capacity 
as    it    is   formally   defined. 
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The  maximum  entropy  E         (n)    of   this  set  occurs  when  the  proba- 

'-         max  '^ 


bility  distribution  is  uniform  over  all  the  patterns,  or  when 
P(A  .)  ,    the  pro 
Equation  (D.2) 


P (A  .) ,    the  probability  of  the  i^^   combination,  is  given  by 


^    nljMN    -    n)l 
^''^i'  {MN)  I  ^^'^' 

Under  these  circiimstances  the  average  maximum  entropy  is 

^max^")  =  -     ^(^i^  1°52  PTITT  =    1°^2  ^  ^"^  i^  ^^'^^ 

i 
or 

H         in)    =    log„  >.,„,  ^^^i  ; r  (D.4) 

max         ^2  (MN    -   n)  \    n\ 

Figure  D.l  shows  the  dependence  of   H         (n)  on  n  for  Af/1/  =  108 
(a  9  x  12  matrix) . 

The  results  in  Figure  D.l  must  be  carefully  interpreted. 
Bit  figures  refer  to  the  number  of  bits  that  must  be  sent,  given 
that  n   elements  are  filled  in,  if  (essentially)  the  coordinates 
of  each  point  are  transmitted.   Clearly,  this  is  not  the  way  that 
the  human  generally  transmits  information  about  patterns.   The 
encoding  used  by  the  human  effectively  takes  into  account  the  in- 
formation shared  by  the  pattern  elements.   For  this  reason  these 
bit  rates  are  upper  bounds  on  the  information  per  exposure. 

By  varying  the  "grain  size"  to  number  of  grains  in  the  pat- 
tern (n/MN) ,  various  maximum  information  rate  sources  can  be 
constructed  from  matrix  patterns  (6).   Clearly,  the  information 
content  of  any  pattern  defined  in  this  way  may  be  changed  by 
varying  the  size  of  the  ensemble,  without  changing  the  pattern 
at  all.   This  is  one  difficulty  encountered  in  applying  statis- 
tical information  measures  in  bit  notation  to  psychophysical 
stimuli . 

A  quantitative  measure  of  stimulus  "information"  that  does 
not  suffer  from  some  of  the  psychophysical  defects  of  the  com- 
mon statistical  measures  (bits)  is  provided  by  the  concept  of 
coordinality  (7) .   This  concept  supplies  a  means  of  predicting 
information-transmission  performance  in  terms  of  the  number  of 
dimensions  or  coordinates  of  the  source.   It  is,  to  a  certain 
extent,  predicated  upon  the  notion  that  humans  are  capable  of 
making  many  more  separate  "measurements"  of  a  stimulus  when  the 
measurements  are  grossly  quantized  in  several  dimensions  than 
when  the  measurements  involve  fine  quantizations  along  a  single 
dimension  (8) .   The  concept  is  quantified  by  Klemmer  (7)  to  the 
point  where  a  general  theorem  may  be  stated: 
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^max  (")  bits 


100- - 


100   108 


Figure    D. 1 . 


H    (n)    vs   n 

max 


The  information  transmitted  in  bits  from  a  visual  display  is 
proportional  to  the  logarithm  of  the  number  of  coordinates  nec- 
essary to  describe  stimulus  display.* 


*Author's    statement. 
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In  the  following  paragraphs  the  coordinality  concept  is 
shown  to  agree  (approximately)  with  the  general  results  of  the 
pattern-recognition  experiment.   Of  course,  the  usefulness  of 
this  concept  is  dependent  upon  our  ability  to  determine  the  co- 
ordinates of  the  stimulus. 

The  maximum  source  information  rate  ^jv,^^^"^  ■^°''"  Patterns 
formed  by  filling  in  n   elements  of  a  108-element  matrix  (9  x 
12)  has  been  computed.   For  the  (5)-  and  (10) -patterns ,  Hmaxin) 
becomes 

H         (5)   =  26.8  bits  (D.5) 

max 

H         (10)  =  46.8  bits  (D.6) 

max 

Thus,  on  the  average,  (5) -patterns  contain  about  5.4  bits  per 
element  and  (10) -patterns  contain  about  4.7  bits  per  element. 
Because  it  is  clear  that  some  patterns  are  much  "easier"  to 
recognize  or  reproduce  than  others,  we  are  lead  to  believe  that 
the  information  content  of  the  easier  patterns  is  smaller  than 
that  of  the  more  difficult  patterns.   In  general,  this  reduction 
in  information  content  occurs  because  the  elements  share  in- 
formation among  themselves.   The  extent  to  which  this  informa- 
tion is  shared  is  often  called  the  redundancy  of  the  pattern. 
The  actual  information  content  i   of  any  particular  pattern  from 
the  (5)-  or  (10) -set  is  reduced  by  the  total  amount  of  informa- 
tion shared  between  the  pattern  elements. 

In  this  research  organizational  principles  have  been  stressed 
rather  than  information  transmission  from  pattern  ensembles  or 
information  sharing  between  pattern  elements.   An  attempt  has 
been  made  to  divide  typical  patterns   into  equivalence  classes 
on  the  basis  of  performance  in  pattern-reproduction  experiments 
for  short-duration  exposures.   The  accuracy  of  the  measurement 
techniques  now  available  does  not  warrant  fine  distinctions  be- 
tween individual  patterns  in  the  ensemble.   On  the  other  hand, 
certain  invariant  features  of  the  results  of  pattern-reproduc- 
tion experiments  which  make  gross  classification  feasible  have 
been  considered. 

In  fact,  the  simple  division  of  (5)-  and  (10) -patterns 
into  random  and  structured  groups  provides  a  basis  for  perform- 
ance prediction  in  several  different  experiments.   The  techniques 
for  making  such  a  distinction  between  patterns  and  the  utility  of 
this  distinction  were  discussed  in  section  3 . 

D.  1.    Information  Transmission  from  Pattern  Sources 

At  this  time  the  results  of  Experiment  2  will  be  related 
to  statistical  information  measures  because: 

1.   The  literature  contains  few  realistic  information- 
transmission  rates  or  rate  bounds  for  pattern  sources. 
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2.  Several  organizational  principles  demonstrated  in  the 
literature  with  much  smaller  input  ensembles  may  be  illustrated 
for  pattern  ensembles. 

3.  The  technique  of  best-fit  grading  (which  adds  to  the 
subject's  response)  has  some  interesting  informational  aspects. 

To  summarize  the  results  of  Experiment  2  in  a  manner  con- 
venient for  an  information-theoretic  analysis,  four  sets  of  ex- 
perimental data  have  been  averaged,  at  each  exposure  duration, 
over  all  subjects:  the  best-fit  grade  for  (10) -patterns ,  the 
best-fit  grade  for  (5) -patterns ,  the  absolute  registration  grade 
for  (5) -patterns ,  and  the  absolute  registration  grade  for  (10)- 
patterns.   These  average  values  are  shown  in  Figure  3.10.   For 
ease  of  interpretation  the  author  has  approximated  the  functional 
relations  in  Figure  3.10  with  straight  lines. 

It  would  be  very  convenient  to  state  that  averaging  per- 
formance grades  over  the  ten  (10) -patterns  and  ten  (5) -patterns 
yields  an  average  measure  of  performance  over  the  ensemble  of 
all  (5)-  and  (10) -patterns.   But  there  is  no  real  basis  for  the 
premise  that  performance  with  the  patterns  used  constitutes  an 
appropriate  statistical  sample  of  performance  over  the  entire 
ensemble.   Thus  all  informational  inferences  are  for  the  simple 
ten-pattern  ensembles  and  should  be  regarded  as  such. 

The  experimental  data  in  Figure  3.10  are  related  with  four 
straight  lines  as  indicated.   In  general,  the  subjects  are  able 
to  register  correctly  about  twice  as  many  elements  from  the 
(10) -patterns  as  from  the  (5) -patterns  (lower  two  lines  in  Fig. 
3.10).   The  best-fit  grades  are  also  much  better  for  the  (10)- 
pattern  set,  and  the  slopes  of  the  four  curves  differ  slightly. 

If  each  of  the  n   elements  of  the  matrix  patterns  is  inde- 
pendent (in  the  sense  that  the  minimum  amount  of  information  is 
shared  between  elements) ,  the  entropy  per  element  (or  square) 
is  bounded  by  Equations  (D.7)  and  (D.8). 


H 


H      (square)  <  5.4  bits/element  (D.7) 

,Q  (square)  <  4.7  bits/element  (D.8) 


Furthermore,  the  information  required  on  the  average  to  locate 
the  coordinates  of  a  single  element  in  108  is  Hq   =    6.75  bits. 
The  average  "distance"  between  the  absolute  registration  and 
best-fit  curves  in  Figure  3.10  is 

£),-  =  2.0  squares  (D.9) 

Dc      =1.7  squares  (D.IO) 

for  the  (10)-  and  (5) -patterns ,  respectively.  If  each  element 
correctly  marked  conveys  as  much  information  as  any  other  ele- 
ment, we  are  on  the  average  effectively  adding  the  amount  of 
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information  implied  by  correct  registration  of  a  single  element 
by  best-fit  grading.   Call  this  additional  information  H^{n). 
The  difference  in  bits  for  the  absolute  registration  curves  and 
the  best-fit  curve  for  each  set  should  be 

H    (n)    =   D   H       (square)  (D.ll) 

or 

H    (5)   =  D^H^    (square)  =  1.7(5.4)  =  9.2  bits     (D.12) 

ff^(lO)  =  ^10^10  (square)  =  2.0(4.7)  =  9.4  bits     (D.13) 

Thus,  the  information  added  by  best-fit  grading  is  the  same  for 
the  (5) -patterns  and  (10) -patterns  and  is  larger  than  Hq   =  6.75 
bits  predicted  from  the  simple  assumption  that  such  grading 
merely  supplies,  on  the  average,  the  coordinates  of  a  single 
element  of  the  pattern  to  each  subject's  response. 

The  best-fit  data  in  Figure  3.10,  which  approximate  a  straight 
line,  imply  that  the  information  actually  conveyed  (H)    in  an  ex- 
posure duration  T   from  the  pattern  ensemble  is  given  by 

H    -  K{n)     log^Q  T    +    Cin)  (D.14) 

where  K {n)    is  the  slope  of  the  absolute  registration  curves  in 
Figure  3.10  modified  by  the  H^    (square)  and  H-^^    (square)  bit 
weighting. 

K,^,         0.6(5.4)  =  3.24  bits  (D.15) 

Z^^Q^   1.1(4.7)  =  5.17  bits  (D.16) 

Thus,  the  average  performance  curves  can  be  interpreted  to  yield 
an  upper  bound  on  human  information  transmission  from  this  source 
over  the  one-glance  region  for  which  they  have  been  measured. 
Furthermore,  they  indicate  that  performance  improves  approxi- 
mately as  the  logarithm  of  the  exposure  duration  with  greater 
improvement  (increase  in  bits  transmitted  per  unit  time  differ- 
ence) noted  for  the  (10) -patterns . 

Figure  D.2  indicates  the  upper  bound  on  transmitted  informa- 
tion as  a  function  of  exposure  duration  for  the  measured  abso- 
lute registration  grade  for  both  the  (5)-  and  (10) -patterns. 
These  curves  indicate  peak  average  information  transmission  rates 
(at  one-frame  exposure)  below  135  bits/sec  for  (10) -patterns  and 
7  0  bits/sec  for  (5) -patterns .   The  maximum  average  information 
rates  over  the  3-sec  (50  frame)  range  of  the  one-glance  region 
are  measured  at  less  than  5.5  bits/sec  for  (10) -patterns  and  3.1 
bits/sec  for  (5) -patterns .   The  long  duration  rates  clearly  re- 
flect saturation  of  the  span  of  immediate  memory  for  total  re- 
port (8,  9)  . 
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The  high  upper  bounds  on  the  short-duration  rates  (135  and 
70  bits/sec)  are  more  difficult  to  explain.   Averbach  and  Sperling 
(10)  suggest  that  rates  for  short-duration  exposures  are  "likely 
to  be  widely  erroneous"  when  the  rate  computation  is  based  upon 
exposure  duration  because  the  stimulus  persists  in  some  form  of 
short-term  memory  for  much  longer  periods.   Often,  this  persisting 
visual  image  is  the  common  afterimage  associated  with  tachisto- 
scope  presentations.   For  the  motion  picture  presentations  used 
here,  there  is  no  apparent  afterimage,  but  other  forms  of  short- 
term  storage  (discussed  in  Chapter  4)  may  account  for  image  per- 
sistence . 

The  information  rates  K (n)    are  seen  to  vary  (approximately) 
as  the  logarithm  of  the  number  of  elements  in  the  display  (4,  5), 
at  least  for  n  =  5  and  n   =   10; 

|-S1°1  =  5.17  =  1.59  (D.17) 


and 


log  (5)     0.69 


These  rates  are  indicative  of  the  effects  of  dimension  of  the 
ensemble  as  well.   The  difference  between  K (10)    and  K{5),    if  one 
assumes  that  going  from  five  to  ten  elements  doubles  the  effec- 
tive dimension  of  the  ensemble,  should  be  1.7  bits  (11). 

KilO)    -   K{5)    =    1.93  bits  (D.19) 

This  agreement  is  significant  in  establishing  the  validity  of 
simple  dimension  measures  in  the  approximate  prediction  of  in- 
formation transmission  from  large  ensembles.   The  small  differ- 
ences noted  here  may  be  due  to  the  fact  that  the  ten  pattern 
averages  for  the  (5)-  and  (10) -patterns  are  not  representative 
of  the  complete  ensemble. 
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THE  VESTIBULAR  SYSTEM  AND  HUMAN  DYNAMIC 

ORIENTATION* 

Jacob  L.  Meiry 
Massachusetts  Institute  of  Technology 


1.  INTRODUCTION 

Daily  human  activity  includes  complex  orientation,  postural 
control  and  movement  coordination.   All  these  tasks  depend  upon 
his  perception  of  motion.   The  vestibular  system  is  recognized 
as  the  prime  motion  sensing  center  in  the  human.   Its  sensing 
capabilities  are  probably  most  compatible  with  every-day  move- 
ments of  man  relative  to  his  surroundings.   However,  man-made 
vehicles  have  extended  the  operating  environment  of  man,  and 
thereby  delegated  new  responsibilities  to  human's  sensory  system. 

This  thesis  studies  primarily  the  vestibular  sensory  system. 
Augmented  by  tactile  and  visual  information,  the  perception  of 
motion  by  the  vestibular  sensors  is  used  in  man's  orientation  in 
three-dimensional  space.   In  a  manual  control  system,  all  these 
sensors  provide  input  information  for  the  motion  control  commands 
of  the  operator. 

Feedback  control  theory  and  its  methodology  are  used  to  de- 
scribe the  characteristics  of  the  sensors  in  conjunction  with 
vehicle  control.   Mathematical  models  are  presented  for  the  dy- 
namic response  of  the  vestibular  sensors.   Analogies  between 
these  sensors  and  electromechanical  instruments  designed  for  simi- 
lar functions  are  drawn.   The  control  activities  of  the  human  op- 
erator in  representative  manual  control  systems  with  and  without 
motion  inputs  are  studies.   The  characteristics  are  summarized 
by  a  new  nonlinear  model  as  well  as  the  conventional  describing 
functions.   The  resultant  control  models  will  be  of  value  to  con- 
trol engineers  concerned  with  the  performance  of  manual  control 
loops.   The  models  for  the  vestibular  sensors  demonstrate  func- 
tional relationships  which  can  lead  to  further  physiological  re- 
search.  Both  engineers  and  physiologists  will  gain  insight  into 
the  capabilities  of  an  important  biological  system,  and  its  use 
by  the  human  in  tasks  of  orientation  control. 

Scope  of  the  Research 

Control  of  orientation  depends  upon  the  ability  to  determine, 
quantitatively,  changes  of  orientation  with  respect  to  a  given 
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which   was    submitted    to    the    Department    of  Aeronautics    and  Astro- 
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kinematically  defined  reference  orientation.   As  in  navigation 
and  control,  orientation  is  defined  as  the  attitude  and  position 
of  a  body-fixed  coordinate  system,  measured  relative  to  a  given 
earth-fixed  frame. 

The  feedback  loop  for  any  orientation  control ,  automatic 
or  manual,  can  be  represented  by  the  functional  block  diagram 
in  Figure  1.1a.   For  an  electromechanical  servo  system,  the 
functional  blocks  are  identifiable,  their  input-output  relations 
are  measurable,  and  the  whole  system  is  amenable  to  rigorous 
mathematical  evaluation.   When  the  task  of  orientation  control 
is  given  to  a  human  operator,  the  system  block  diagram  is  modi- 
fied to  that  of  Figure  1.1b.   Application  of  servoanalysis  to 
such  manual  control  systems  has  two  major  goals:  (1)    mathemati- 
cal models  of  each  of  the  "components"  (sensors,  compensation, 
etc.)  may  be  identified;  (2)    overall  human  operator  transfer 
functions  may  be  obtained  and  applied  to  manual  control  system 

analysis. 

In  general,  orientation  control  by  a  human  operator  is  a 
multi-input  control  system  as  shown  in  Figure  1,2  (153).   Human 
control  characteristics  in  fixed  base  simulation,  with  visual 
input  and  manual  output,  have  been  studied  extensively  for  a  wide 
variety  of  controlled  elements  (50,  89,  129,  148).   The  research 
in  this  thesis  is  concerned  with  another  important  path  under- 
taken through  this  loop.   Sfensory  information  is  processed 
through  the  mechanism  of  the  vestibular  system,  supplemented  by 
tactile  sensation  and  visual  reference.   At  the  motor  end,  the 
operator  uses  manual  control.   The  central  nervous  system  (CNS) 
is  the  controller  for  the  control  system.   Time  variant  charac- 
teristics of  the  operator,  such  as  adaptation  and  learning  are 
not  included  in  this  study.   This  subsystem  of  the  general  ori- 
entation control  problem  is  given  in  Figure  1.3. 

The  pattern  of  research  follows  the  techniques  that  would 
be  used  in  analysis  of  a  comparable  automatic  control  system. 
The  dynamic  characteristics  of  the  vestibular  system  are  studied 
for  their  inherent  interest  and  also  as  a  "component"  of  the 
operator.   Compensating  eye  movements  in  the  presence  of  head 
and  body  motions  are  discussed  from  a  space  stabilization  point 
of  view.   The  capabilities  of  the  human  operator  are  reviewed 
on  the  basis  of  the  information  he  receives  from  his  various 
sensors.   Manual  control  of  orientation,  when  the  vehicle  is_ 
driven  in  modes  of  motion  specific  to  a  given  sensor  or  combina- 
tion of  sensors,  is  analyzed  in  terms  of  operator  describing 
functions.   Finally,  the  compensation  capabilities  of  the  human 
operator  in  controlling  the  orientation  of  an  unstable  system 
are  investigated  in  pure  visual,  pure  vestibular,  and  combined 
modes.   Results  are  presented  in  terms  of  an  on-off  model  for 
the  operator  and  analyzed  in  the  phase  plane. 

Application  of  the  Research 

Physiology    and   Biology.       Subjective  orientation  is  a  re- 
sult of  the  processing  of  numerous  inputs  coming  from  separate 
sensors.   In  physiology,  motion  is  sensed  by  receptors  informing 
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the  brain  about  localized  sensations;  in  feedback  theory  this  is 
considered  as  a  system  with  multiple  sensors  feeding  a  controller. 
The  goal  of  the  research  in  the  two  fields  are  complementary. 
The  control  engineer  is  interested  in  the  overall  performance  of 
the  sensors,  the  physiologist  in  the  description  of  the  associ- 
ated body  mechanisms.   Engineering  characteristics  of  the  vesti- 
bular system,  the  neck  proprioceptors  or  the  body  pressure  re- 
ceptors described  in  terms  of  a  model,  do  not  guarantee  a  physio- 
logical correspondence.   The  mathematical  model  describes  the 
sensors'  response  in  a  compact  mathematical  notation  and  is  easy 
to  simulate  and  analyze.   There  is  no  reason  to  expect  that  a 
lag-lead  network  corresponds  to  the  actual  biological  mechanism. 
However,  the  underlying  physiological  processes  associated  with 
a  model  could  be  investigated.   The  physiologist,  guided  by  the 
functional  relationship  of  the  mathematical  model,  could  postu- 
late and  search  for  the  physiological  counterparts  of  the  engi- 
neering analog. 

Aerosyaoe    Medicine    and   Psychology .       Is  the  human  fit  to  ac- 
complish space  missions?   Is  a  given  individual  conditioned  to 
the  expected  motion  parameters  of  the  mission?   These  questions 
are  of  great  importance  in  this  era  of  rapid  technological  achieve- 
ments.  The  common  denominator  of  this  medical  and  psychological 
interest  and  responsibility  is  the  ability  of  the  human  to  judge 
his  spatial  orientation. 

Spatial  disorientation  or  vertigo  may  be  crucial  for  sur- 
vival and  successful  completion  of  a  mission.   Poor  motor  co- 
ordination and  prolonged  reaction  time  are  manifestations  of 
inability  to  deal  effectively  with  the  environment.   The  psycho- 
logical symptoms  accompanying  vertigo  are  equally  serious. 

The  mathematical  model  of  the  vestibular  system  is  basic 
for  evaluating  the  expected  subjective  orientation  of  the  human. 
Expected  vehicle  motions  from  a  mission  profile  may  be  applied 
to  the  vestibular  system  model  to  predict,  potential  difficulties. 
On  the  basis  of  the  vestibular  model,  a  medical  criterion  for 
personnel  selection  may  be  developed  along  with  a  minimum  standard 
for  medical  fitness  of  flying  personnel. 

The  psychological  training  of  the  human  should  not  be  under- 
estimated.  Pilots  have  been  trained  to  fly  by  instruments  and 
to  ignore  conscious  sensations  of  body  orientation.   Ice  skaters 
and  ballet  dancers  learn  to  suppress  certain  vestibular  or  visual 
information.   Appropriate  psychological  conditioning  must  con- 
sider the  environment  where  the  human  will  be  functioning.   This 
environment  imposes  dynamic  conditions  which  the  operator  com- 
pares to  a  set  of  previous  experiences.   The  observations  or  il- 
lusions which  arise  under  these  conditions  are  a  function  of  his 
previous  exposure  to  similar  input  accelerations.   The  mathemati- 
cal model  of  the  vestibular  system  is  valid  for  the  normal  en- 
vironmental conditions  for  man  on  earth.   Training  for  operation 
in  different  environments  should  be  considered  as  modifications 
with  respect  to  this  built-in  "reference." 
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Control    Engineering    and   Human   Engineeving .       The  control 
engineer  attempts  to  associate  a  mathematical  description 
with  each  physical  element  of  a  control  system.   This  descrip- 
tion represents  a  relation  between  the  input  variable  to  the 
component  and  its  output  regardless  of  the  type  of  physical 
parameters  involved  (acceleration,  current,  torque,  etc.).   A 
body  of  test  methods  has  been  developed  for  identification  of 
these  input-output  transfer  functions.   Similarly,  methods  of 
analysis  are  available  to  evaluate  the  stability  and  performance 
of  a  control  system  on  the  basis  of  the  characteristics  of  its 
individual  components.   In  a  preliminary  design  of  an  automatic 
control  system,  the  control  engineer  can  analyze  a  whole  series 
of  systems,  select  components  with  characteristics  meeting  his 
criteria  and  make  design  decisions  on  the  basis  of  mathematical 
analysis. 

The  human  has  sensors,  can  act  as  a  controller  and  can 
compensate,  and  has  the  strength  to  execute  control  decisions. 
Each  or  all  of  these  human  capabilities  can  be  utilized  in  a 
control  system.   However,  the  analysis  of  manual  control  sys- 
tems, even  in  the  preliminary  design  stage,  is  still  generally 
done  by  simulation.   This  approach  is  necessary,  since  our  cur- 
rent knowledge  of  the  engineering  characteristics  of  man  is 
quite  limited.   Simulation  is  certainly  a  necessity  in  the 
final  design  stages  of  manned  systems.   However,  a  degree  of 
flexibility  in  design  of  manned  systems  comparable  to  that 
found  in  automatic  system  design  may  be  achieved  with  the 
formulation  of  models  which  adequately  represent  control  char- 
acteristics of  the  human. 

The  experimental  data  presented  in  this  thesis  is  sum- 
marized in  simple  mathematical  models  of  the  vestibular  motion 
sensors,  a  model  of  the  eye  control  system  in  the  presence  of 
rotational  motion,  and  describing  functions  for  the  human  op- 
erator in  manual  control  systems  with  motion  inputs. 

This  research  work  represents  a  further  step  in  the  descrip- 
tion of  overall  human  control  characteristics  and  those  of  his 
sensors.   As  such,  it  can  be  used  to  estimate  the  ability  of  the 
human  to  obtain  orientation  information  with  his  various  sensors 
and  subsequently  to  utilize  it  for  vehicle  orientation  control. 

Human  engineering  is  concerned  with  the  accommodation  of 
the  human  operator  in  an  environment  which  will  allow  him  to 
perform  his  task  most  efficiently.   Relevant  parts  of  this  re- 
search concern  the  effects  of  head  motion  on  the  human's  ability 
to  fixate  an  instrument  or  to  perceive  vehicle  motion.   The 
models  of  the  vestibular  sensors  and  the  eye  movement  control 
system  can  be  used  as  guides  for  vehicle  interior  design,  appro- 
priate to  the  control  tasks  assigned  to  the  human  operator. 
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2.  THE  VESTIBULAR  SYSTEM 

The  nonauditory  section  of  the  human  inner  ear  is  the 
recognized  center  of  motion  sensors.   This  center,  the  vesti- 
bular system,  is  one  of  the  sensory  systems  which  provide  in- 
formation of  body  orientation  and  balance.   Because  the  ability 
of  the  human  to  orient  himself  and  preserve  equilibrium  with 
the  surrounding  environment  is  a  basic  prerequisite  for  normal ^ 
existence,  a  sizable  research  literature  is  devoted  to  the  vari- 
ous aspects  associated  with  the  function  of  the  vestibular  sys- 
tem.  The  medical  researchers  study  the  balance  mechanisms  of 
mammalians  and  attempt  to  correlate  their  findings  with  the  role 
and  the  function  of  the  vestibular  system  in  humans.   The  dy- 
namic characteristics  of  the  vestibular  sensors  and  pertinent 
data  on  thresholds  of  perceptions  of  motions  with  corresponding 
response  times  is  another  field  of  concentrated  research  effort. 

This  section  will  review  the  background  material  on  the 
vestibular  system.   The  next  section  will  analyze  the  semicircu- 
lar canals,  the  human  angular  accelerometers ,  with  their  char- 
acteristics as  determined  by  previous  work  and  from  experiments 
by  the  author.   The  otoliths,  the  linear  motion  sensor  of  the 
vestibular  system,  are  the  subject  of  the  third  section,  where 
experimental  results  obtained  here  along  with  a  critical  ex- 
amination of  the  otolith  sensing  capabilities  are  summarized 
in  a  mathematical  model.   These  three  sections  present  the 
physiological  and  the  engineering  description  of  the  human 
motion  sensors  as  known  at  the  present  time. 

Physiology  and  Anatomy  (7,  76,  77) 

The  inner  ear  is  divided  into  two  parts:  (1)    the  cochlea 
serving  auditory  function,  and  (2)    a  nonauditory  portion,  the 
vestibular  system.   This  structure,  also  called  the  labyrinth, 
lodges  the  sensors  associated  with  maintenance  of  balance  and 
orientation  in  three-dimensional  space.   One  distinguishes  be- 
tween the  bony  labyrinth  and  the  membranous  labyrinth.   The 
bony  labyrinth  is  a  cavity  tunneled  in  the  temporal  bone  of 
the  skull.   Its  structure  forms  three  ducts,  the  semicircular 
canals,  and  the  vestibule.   This  elaborate  canal  system  con- 
tains in  its  cavities  the  membranous  labyrinth  suspended  in 
perilymph.   The  suspension  system  of  the  membranous  labyrinth 
does  not  allow  it  to  move  relative  to  the  skull.   Thus  the  ac- 
celerations acting  on  the  membranous  labyrinth  are  those  ap- 
plied to  the  head.   The  bony  semicircular  canals  lodge  the 
three  semicircular  canals,  while  the  vestibule  contains  the 
utricle  and  the  saccule  (7).   (See  Fig.  2.1.)   The  membranous 
labyrinth  contains  fluid  called  endolymph. 

The  utricle  is  the  large,  oblong  sac  occupying  the  vesti- 
bule.  Its  lower  part  forms  a  pouch  where  it  thickens  over  an 
area  of  about  6  mm2  (2  mm  x  3  mm) ,  and  is  known  as  the  macula. 
The  otolith,  a  gelatinous  substance  with  calcium  carbonate 
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Figure    2,1.       The   Membranous    Inner    Ear 

grains  in  it,  and  of  specific  density  of  around  2.95,  is  sup- 
ported over  the  macula  by  strands  allowing  a  limited  sliding 
travel  of  about  0.1  mm.   The  macula,  the  receptor  end  of  this 
otolithic  organ,  provides  the  bed  for  the  utricular  branch  of 
the  vestibular  nerve.   It  also  has  sensory  hairs  imbedded  in  it, 
which  at  their  other  end  penetrate  the  otolith.   Figure  2.2  is 
a  crosssection  of  the  utricle  showing  the  macula  and  the  otolith 
together  with  their  supporting  and  sensory  cells  (77).   Note 
that  the  macula  and  otolith  are  not  exactly  planar;  a  small 
portion  of  the  sensor  makes  an  angle  of  120°  with  the  mean 
plane  of  the  macula.   Nevertheless,  the  plane  associated  with 
the  utricle  is  a  plane  which,  for  an  erect  head,  is  elevated 
between  2  6°  to  3  0°  above  the  horizontal  plane.   The  two  utricles 
(one  from  each  inner  ear)  are  located  in  the  same  plane. 

The  utricle  is  a  multidimensional  linear  accelerometer 
with  the  otolith  being  the  moving  mass.   The  plane,  associated 
with  the  sensor,  is  relevant  in  determining  the  input  accelera- 
tions to  it. 
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Figure    2.2.       Schematic    drawing    of   a    Cross    Section 
of  an    Otolith   and    Its   Macula 

0  is  the  otolith,  suspended  by  strands  which 
run  from  the  margins  to  the  macula,  consisting 
of  supporting  cells  (Sp  C)  and  sensory  cells 
(S  C) •   Between  the  otolith  and  the  macula  there 
is  a  thin  layer  (L)  to  allow  the  otolith  to 
slide  over  the  macula.   N  is  the  nerve. 


The  saccule  is  an  organ  with  histological  structure  iden- 
tical to  that  of  the  utricle.   The  plane  of  the  saccular  macula 
is  perpendicular  to  that  of  the  utricle. 

The  three  semicircular  canals  are  above  and  behind  the 
vestibule.   Their  structure  is  planar,  lying  in  planes  which 
are  roughly  orthogonal  to  each  other.   The  horizontal  (lateral) 
canal  is  in  a  plane  elevated  about  25°  to  30°  from  the  hori- 
zontal plane.   The  other  two  canals,  the  posterior  and  the 
superior  vertical,  are  in  approximately  vertical  planes  (see 
Fig.  2.1).   Note  that  the  horizontal  canals  of  the  two  ears  lie 
in  the  same  plane,  while  the  superior  canal  of  the  left  ear  is 
coplanar  with  the  posterior  one  of  the  right  ear  and  vice  versa. 

The  three  semicircular  canals  have  very  nearly  the  same 
structure  and  dimensions.   Each  canal  starts  at  the  utricle, 
forms  approximately  2/3  of  a  circle  with  outer  diameter  of  4 
to  6  mm,  dilates  at  the  ampulla,  contracts  again,  and  terminates 
at  the  other  end  of  the  utricle.   The  canals  have  five  orifices 
to  the  utricular  sac,  since  the  posterior  and  the  superior 
canals  have  a  common  duct  along  the  intersection  line  of  their 
planes.   The  ampulla  is  nearly  sealed  by  the  ampullary  crista 
and  the  cupula.   The  crista  contains  supporting  hairs  and  sen- 
sory cells  which  project  into  the  cupula,  a  domelike  gelatinous 
mass  (77).   (See  Fig.  2.3.)   The  cupula  is  of  equal  density  to 
the  endolymph  which  fills  the  narrow  (0.3  mm  in  diameter)  semi- 
circular canals.   In  contrast  to  the  structure  of  the  utricle 
and  the  saccule,  there  is  no  interspace  between  the  crista  and 
the  cupula,  although  sliding  movement  of  the  cupula  is  feasible. 
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Figure    2.3. 


Schematic    Drawing    of  a    Cross    Section    Through, 
an   Ampulla    and    Crista 


A  R,  ampulla  roof.   C  R,  crista,  consisting  of  S  C 
(sensory  cells),  supporting  cells,  and  N  (nerve 
fibres) .   Between  cupula  and  crista  there  is  the 
ISP  (intercupular  space) .  U,  utricle  (77) . 


The  semicircular  canals  are  heavily  damped,  angular  ac- 
celerometers.   Their  arrangement  in  three  perpendicular  planes 
provides  a  way  to  sense  components  of  angular  acceleration 
along  three  axes  which  are  amenable  to  easy  vectorial  manipula- 
tion. 

The  vestibular  nerve  sends  a  branch  to  each  crista  of  the 
canals  and  the  utricular  macula,  while  two  branches  are  im- 
bedded in  the  saccule.   The  transmission  of  information  from 
the  vestibular  sensors  to  the  central  nervous  system  is  by  fre- 
quency modulation.   When  unstimulated,  the  sensors  show  nerve 
action  potentials  of  about  8  to  10  pulses  per  second  (pps) . 
For  the  semicircular  canals,  the  firing  rale  will  increase  or 
decrease  according  to  the  direction  of  the  input  angular  ac- 
celeration and  in  proportion  to  its  strength.   Similar  respon- 
ses may  be  recorded  for  the  utricular  macula  but  without  clear 
directional  response. 

The  physiology  and  topology  of  the  labyrinth  throw  some 
light  upon  its  sensory  characteristics.   The  fact  that  the 
semicircular  canals  have  their  mean  planes  very  nearly  perpen- 
dicular allows  three-dimensional  sensing  of  angular  accelera- 
tions.  Since  the  canals  open  into  the  utricle,  interaction 
between  canals  is  plausible  by  virtue  of  endolymph  flow. 
Moreover,  the  posterior  and  the  superior  canals  share  a 
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common  duct.   Thus  they  are  stimulated  to  a  different  degree, 
perhaps,  but  simultaneously.   The  dynamic  characteristics  of 
the  canals  depend  upon  the  specific  density  of  the  cupula  and 
the  endolymph,  and  v/ould  alter  if  the  cupula  does  not  seal  the 
ampulla  while  deflected. 

To  summarize,  the  anatomy  of  the  labyrinth  displays  two 
different  groups  of  sensors.   Their  structure  is  distinctly 
different,  as  are  their  sensory  functions. 

Orientation-Reference  Coordinates 

The  location  and  the  mean  planes  of  the  vestibular  sensors, 
as  well  as  their  attitude  in  the  head  is  known.   Thus  the  geo- 
metric coordinates  of  the  vestibular  system  are  unique  in  any 
given  head  axis  system.   Because  there  is  no  relative  motion 
between  the  head  and  the  labyrinth  sensors,  head  movements  can 
be  referred  to  as  inputs  of  the  vestibular  system.   Consequently, 
a  head  fixed,  axes  frame,  which  considers  the  symmetry  of  the 
labyrinths,  is  a  convenient  coordinate  system  to  define  in  it 
the  accelerations  acting  on  the  skull. 

Two  perpendicular  planes  are  defined  for  the  head,  the 
frontal  plane  and  the  sagittal  plane.   The  latter  divides  the 
head  into  two  symmetrical  halves  and  contains  the  sagittal  X^ 
(fore  and  aft)  axis  and  the  vertical  Y/^  axis.   The  intersec- 
tion of  the  frontal  and  the  sagittal  planes  form  the  vertical 
axis  such  that  it  runs  colinear  to  the  gravity  vector.   If  the 
origin  of  the  head  coordinate  system  is  located  between  the 
labyrinths,  the  sagittal  axis,  for  an  erect  head,  will  run 
horizontal,  and  the  vertical  axis  is  along  the  neck  (see  Fig. 
2.4).   The  lateral  axis,  Z^,  completes  the  right-handed  co- 
ordinate system.   Note  that  the  frame  defined  here  is  related 
to  the  functional  planes  of  the  sensors  by  a  single  transforma- 
tion through  an  alignment  matrix  [6]. 

Orientation  of  the  body  is  defined  with  respect  to  a  given 
system  of  coordinates — the  reference  system.   Dynamic  orienta- 
tion is  then  the  ability  to  determine  the  relative  motion  be- 
tween the  head  axes  system  and  the  reference  coordinates.   The 
natural  selection  of  the  reference  frame  (Xg^    1q,    Zq)    is  to 
have  it  coincide  with  the  head  axes  for  normal  unaccelerated 
body  posture.   These  earth-fixed  axes  do  not  rotate  or  trans- 
late . 

The  issue  of  normal  posture  refers  to  the  relative  posi- 
tion of  the  head  with  respect  to  the  trunk.   Absence  of  bend- 
ing or  torsion  of  the  neck  is  a  normal  configuration  of  head 
and  body  interconnection.   In  this  context,  suspension  of  the 
body  upside-down,  with  the  head  free,  is  still  an  acceptable 
posture . 
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Figure    2.4.       The    Head   Planes    and    the    Head  Axis    System 
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Control  Variables 

The  vestibular  sensors  are  sensitive  to  accelerations, 
thus  the  input  variable  to  the  vestibular  system  is  a  vector 
having  direction  and  magnitude o   The  output  quantity,  however, 
is  not  a  vector  in  the  strict  sense.   Information  from  the 
semicircular  canals  and  the  otoliths  is  sent  to  the  central 
nervous  system  and  thereafter  an  awareness  of  the  sensation  of 
motion  is  perceived.   This  perceived  output  variable  preserves 
the  indication  of  direction  like  a  vector.   However,  sense  of 
magnitude  is  applicable  only  on  a  comparative  basis,  where  mo- 
tions are  faster  or  slower  without  an  absolute  scale.   It  is 
unusual  to  assign  a  perceived  variable  as  an  output  of  a  con- 
trol system,  particularly  when  it  only  resembles  the  input. 
Nevertheless,  perceived  orientation  is  the  most  important  sensa- 
tion the  human  experiences  in  response  to  an  input  acceleration 
and  will  be  considered  here  as  the  output  of  the  vestibular 
system.   There  are  also  some  objective  measurements  of  activity 
of  the  vestibular  sensors,  the  most  known  ones  being  observa- 
tions of  compensatory  eye  movements.   However,  those  are  de- 
rived variables  with  some  transfer  characteristics  related  to 
the  output  of  the  vestibular  sensors. 

In  conclusion,  the  vestibular  system  should  be  examined 
as  a  sensory  complex  of  accelerometers  with  certain  dynamic 
characteristics  which  establish  the  input-output  relations  be- 
tween accelerations  applied  in  the  head  axes  frame  and  per- 
ceived orientation  as  indicated  by  the  human. 

Identification  Processes 

In  humans,  identification  of  sensing  capabilities  of  the 
vestibular  system  is  associated  closely  with  experiments  of 
psychophysical  nature.   Validity  and  usefulness  of  experimental 
work  of  this  kind  depends  on  the  correlation  one  can  draw  be- 
tween the  precise,  and  usually  well  defin'ed,  input  conditions 
and  the  human  response. 

Control  engineering  theory  offers  a  number  of  identifica- 
tion techniques  where  only  yes  and  no  types  of  responses  will 
suffice.   For  a  step  or  an  impulse  input,  indication  of  onset 
of  perception  or  termination  of  it  contains  the  pertinent  data 
on  the  characteristics  of  the  sensor.   Standard  frequency  re- 
sponse for  a  linear  system  required  only  phase  lag  or  lead  data 
to  identify  the  time  constants  of  the  system. 

Stimulation  of  the  vestibular  system  is  a  source  of  vari- 
ous illusions  which  the  human  interprets  as  a  subjective  ori- 
entation.  For  identification  purposes,  these  illusions  are  an 
excellent  tool  to  obtain  the  time  course  of  a  sensation  or  a 
steady  state  value  (gain  and  sensitivity)  of  a  transfer  func- 
tion.  The  objective  measurements  of  vestibular  activity,  such 
as  measurement  of  eye  movements,  is  probably  the  most  effective 
and  reliable  method  of  response  identification.   As  noted 
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before,  compensatory  eye  movements  indicate  stimulation  of  the 
semicircular  canals.   However,  the  relation  between  these  move- 
ments and  the  dynamics  of  the  canals  has  to  be  determined  by 
comparison  with  psychophysical  experiments. 

Finally,  identification  techniques  suitable  for  manual 
control  systems  could  be  applied  to  the  vestibular  sensors. 
If  the  experimental  subject  (human  operator  for  these  condi- 
tions) is  placed  in  an  orientation  control  loop  with  the  func- 
tion of  a  sensor  and  a  controller  assigned  to  him,  the  system 
response  can  be  analyzed  in  terms  of  control  characteristics 
of  equivalent  "black  boxes."   The  block  corresponding  to  the 
human  operator  will  indicate  the  intrinsic  dynamics  of  his 
sensors  and  the  effects  of  data  processing  by  the  central 
nervous  system. 


3.  THE  SEMICIRCULAR  CANALS 

The  semicircular  canals  are  the  rotational  sensors  of  the 
vestibular  system.   When  stimulated,  they  participate  in  the 
control  of  the  postural  reflexes  of  the  body  and  initiate  com- 
pensatory eye  movements  in  order  to  preserve  the  body  balance 
and  reference  with  respect  to  the  environment.   Consciously, 
the  human  is  aware  of  the  rotations  his  head  undergoes.   The 
information  on  orientation  the  human  can  obtain  from  his  semi- 
circular canals  can  be  analyzed  by  control  engineering  methods 
and  summarized  in  a  mathematical  model  describing  the  dynamic 
characteristics  of  the  three  semicircular  canals. 

Input  Vector  and  Sensitive  Axis 

Rotation  of  the  head  has  been  identified  as  the  motion 
which  stimulates  the  semicircular  canals.   Another  observation 
indicates  that  the  canals  cease  to  show  activity  during  pro- 
longed periods  of  rotation  with  constant  angular  velocity. 
The  conclusion  is  that  the  semicircular  canals  are  sensitive 
to  angular  accelerations,  which  are  applied  about  an  axis  normal 
to  the  plane  of  the  canal.   Because  there  are  three  semicircular 
canals  in  each  ear,  input  accelerations  are  sensed  along  three 
mutually  orthogonal  axes  and  probably  summed  vectorially  in 
the  central  nervous  system. 

When  the  canals  are  stimulated,  the  human  is  consciously 
aware  of  a  rotational  motion,  a  perceived  sensation  of  rota- 
tion.  Furthermore,  the  time  course  of  the  perceived  sensation 
will  depend  upon  the  dynamic  behavior  of  the  canals,  which 
can  be  simulated  by  a  simple  mechanical  model. 
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A  Physical  Model  for  the  Semicircular  Canals 

The  theory  of  operation  of  the  semicircular  canals  was 
first  set  by  Steinhausen  and  is  based  on  the  concept  of  a 
heavy  damped  torsion  pendulum  for  the  cupular  mechanism  (154)  . 
In  this  model,  the  fluid  ring  of  the  canals  corresponds  to 
the  moment  of  inertia  of  the  pendulum  and  the  spring  restor- 
ing torque  is  provided  by  the  elasticity  of  the  cupula.   The 
heavy  damping  is  attributed  to  the  viscous  torques  arising 
from  the  flow  of  the  endolymph  through  the  capillary  canals 
(157).   (See  Fig.  3.1.)   This  theory  is  based  on  the  assump- 
tion that  over  a  certain  range  of  angles  the  cupula  deflects 
while  still  sealing  the  ampulla.   The  assumption  of  a  pendu- 
lum model  indicates  that  the  cupuloendolymph  system  will  obey 
a  second  order  linear  differential  equation  first  formulated 
by  van  Egmond ,  Groen,  and  Jongkees  (157)  .   As  shown  in  Figure 
3.1,  the  cupula  deflection  is  assumed  equal  to  the  angle  of 
rotation  of  the  endolymph.   This  assumption  approximates  the 
canals  to  a  tube  with  a  constant,  cross  sectional  area.   The 
angular  deviation  of  the  cupula  with  respect  to  the  skull  is 
given  by 

IQ    +    BQ    +    Ke    =    la  (1) 

where  I  =   moment  of  inertia  of  the  endolymph;  B   =   viscous 
damping  torque,  at  unit  angular  velocity  (rad/sec)  of  the 
endolymph  with  respect  to  the  skull;  K  =    stiffness,  torque 
per  unit  angular  deflection  of  the  cupula;  6  =  angular  devia- 
tion of  the  cupula  with  respect  to  the  skull  (rad) ;  6  =  angu- 
lar velocity  of  the  cupula  with  respect  to  the  skull  (rad/ 
sec) ;  0  =  angular  acceleration  of  the  cupula  with  respect  to 
the  skull  (rad/sec2)  ;  and  a.   =  input  angul-ar  acceleration  along 
the  sensitive  axis  of  the  canal  (rad/sec^) . 

Equation  (1)  represents  the  time  response  of  the  cupula, 
in  any  given  semicircular  canal,  as  a  function  of  the  input 
stimulation.   The  response  is  seen  to  depend  upon  two  para- 
meters: B/I   and  K/I, 

Rotation  About  the  Vertical  Cl/jJ  Axis 

The  reference  frame  of  orientation  and  the  head  axes  were 
assumed  to  coincide  for  a  nonmoving,  erect  head.   For  these 
initial  conditions,  rotation  of  the  head  about  the  earth-fixed 
vertical  axis  (Y^)  stimulates  the  semicircular  canals  sensitive 
to  accelerations  about  the  Y}^   axis.   The  tangential  and  cen- 
trifugal accelerations  associated  with  this  rotation  are  below 
the  threshold  of  perception  of  the  otoliths.   If  angular  ac- 
celerations are  applied  about  the  Yq    (and  Y-,)    axis,  the  para- 
meters of  the  canals  can  be  determined  without  interference  ef- 
fects from  the  linear  acceleration  sensitive  otoliths. 
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Figure    3.1.       Sohematio    Diagram   of   the    Semicircular 

Canal    (157) 

The  second  order  characteristic  equation  for  the  canals 
(Eq.  1)  has  two  roots,  w,  and  0)2: 
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However,  since  the  viscous  torque  is  very  high  compared  to  the 
elastic  one,  an  assumption  has  been  made  that  K/B    <<  B/I ,    yield- 
ing two  real  roots: 
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The  transfer  function  of  the  canals,  from  angular  accelera- 
tion about  the  head  vertical  axis  (aj,)  to  cupula  position  (0) 
is  given  by 
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where  s  =  the  Laplace  transform  operator. 

The  time  constants  of  the  cupular  model  B/K   and  I/B   are 
widely  separated,  thus  imposing  a  certain  difficulty  on  their 
experimental  evaluation.   Van  Egmond  et   at.    established  the 
values  of  those  time  constants  within  10  to  20  percent  allow- 
ance for  experimental  errors  (157) .   Their  assumption  is  that 
the  perceived  sensation  of  angular  velocity  is  related  to  the 
cupula  deflection.   According  to  this  assumption,  measurements 
taken  on  parameters  of  perceived  sensations  correspond  to  the 
parameters  of  the  cupular  model. 

The  duration  of  a  transient  response  of  the  cupula  to  a 
velocity  step,  plotted  against  the  magnitude  of  the  step  input 
is  called  by  van  Egmond  "subjective  cupulogram. "   Indeed,  mea- 
surement of  duration  of  perception  as  reported  by  a  subject  is 
one  reliable  method  to  determine  the  value  of  B/K.      The  core 
of  the  method  relies  on  the  instantaneous  stop  of  a  platform 
moving  with  constant  angular  velocity  and  subsequently  record- 
ing the  time  of  sensation  reported  by  the  subject.   Mathematic- 
ally, for  a  step  of  8°/sec,  the  time  response  of  the  cupula, 
initially  at  rest  will  be 


0(t)  =  8(J/S)  [.-(^/^^*  -.-(^/^)*] 


(5) 


Physically,  due  to  the  angular  momentum  imparted  to  the  endo- 
lymph  and  the  viscous  torque,  the  cupula  is  deflected  to  a  cer- 
tain maximum  angle  following  which  it  slowly  returns  to  zero 
under  the  influence  of  its  own  elastic  torque  opposed  by  vis- 
cosity.  The  sensation  the  subject  reports  during  the  process, 
is  of  rotation  in  the  direction  of  the  input  step  with  slowly 
decreasing  velocity.   The  return  phase  of"  the  cupula  will  ex- 
hibit simple  exponential  decay 

e  (t)  =  8  {I/B)e-{K/B)t  (6) 

since  the  term  e   of  equation  (5)  is  e-{B/I)t<<l. 

The  sensation  of  rotation  the  subject  perceived,  will  stop, 
the  moment  the  cupula  reaches  a  deflection  9^^^^,  (theta  minimum) 
which  corresponds  to  the  deflection  for  threshold  of  perception. 
Then,  the  approximate  time  for  this  event  will  be: 


t    =    B/K    log  ^{I/B)  (d/Q^^^)j  (7) 

or 

t    =    B/K    log  (I/BQ^^^)    +     {B/K)log    3  (8) 

A  series  of  time  measurements  for  angular  velocity  step  respon- 
ses plotted  on  semilogarithmic  scale  will  yield  the  time  constant 
B/K  =    10  sec  (157).   (See  Fig.  3.2.) 
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Besides  testing  for  transient  response,  the  cupular  model 
for  the  semicircular  canals  can  also  be  studied  in  the  trans- 
formed frequency  domain.   The  increasing  phase  shift  of  subjec- 
tive sensation  of  angular  velocity  with  respect  to  the  input 
acceleration  is  an  indication  reflecting  the  time  constants  of 
the  model.   Consider  an  input  sinusoidal  rotation  with  frequency 
wQ  =  'i^/I ,    the  undamped  natural  frequency  of  the  cupular  model. 
For  this  input  the  angular  deflection  of  the  cupula  lags  the 
input  acceleration  by  90°.   Thus,  the  cupula  is  in  phase  with 
the  input  angular  velocity,  which  is  zero  at  the  peaks  of  the 
rotation.   At  these  instances,  the  subjective  feeling  will  be 
that  of  rest.   Experimenting  with  a  torsion  swing,  van  Egmond 
found  that 
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Figure    2.2.       Duration   of  Sensation   As   a   Function 
of   the    Velocity    Step    Input 
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with  this  result,  the  second  time  constant,  I/B,    of  the  cupular 
model  is  evaluated  as 

1/B    =    (1/wq)  (Z/B)  =  0.1  sec  (10) 

With  the  proper  values  of  time  constants,  the  transfer 
function  for  the  semicircular  canals  as  given  in  Eq.  (4)  cor- 
responds to 

e  (s)  ^ 

~y  ^ST         "      (108     +     1)    (O.lS     +1)  ^■'■-'■^ 

h 

Equation  (11)  indicates  that  the  steady  state  angle  of  the 
cupula,  subjected  to  stimulation  of  constant  angular  accelera- 
tion is  6  ,  ^   .  =  ay,  .   The  assumption  can  be  verified  by  using 

the  velocity  step  response  test  in  conjunction  with  subjective 
estimation  of  total  angular  travel.   When  van  Egmond  instructed 
his  subjects  to  report  completion  of  full  revolutions,  the  ex- 
perimenter could  determine  the  average  subjective  velocity  for 
the  subject.   Indeed,  the  indication  confirmed  decay  with  a 
time  constant  of  B/K  =   10  sec.   However,  when  the  velocity  was 
extrapolated  to  its  initial  value,  it  agreed  absolutely  with 
the  applied  step  of  angular  velocity  (157).   (See  Fig.  3.3.) 
This  finding  brings  to  the  modification  of  the  cupular  trans- 
fer function  when  associated  with  subjective  perception  of 
angular  velocity  such  as 

subjective  angular  velocity  (g)  _  10 (io\ 

a   (s)  "    (10s  +  1)  (0.1s  +  1)    ^       ' 

Note  that  the  parameters  of  the  cupular  model  and  the  as- 
sociated transfer  function  as  presented  in  Eq.  (12)  were  tested 
for  subjective  perception.   This  is  in  agreement  with  the  defi- 
nition of  a  transfer  function  for  the  vestibular  sensors  where 
the  output  variable  is  perceived  sensation. 

The  time  constants  of  the  cupular  model  for  input  accelera- 
tions about  the  vertical  head  axis,  especially  the  long  one, 
can  be  measured  by  objective  methods  based  on  the  compensatory 
eye  movements  elicited  during  periods  of  stimulation  of  the 
canals.   Section  4  will  discuss  the  relations  between  the  semi- 
circular canals  and  the  eye  motor  system.   Another  identifica- 
tion method,  dealing  with  an  illusion  of  vestibular  origin  is 
examined  under  Habituation,  later  in  this  section. 

Pure  theoretical  attempts  to  estimate  the  parameters  of 
the  semicircular  canals  are  based  on  approximating  them  to  cir- 
cular tubes  with  viscous  flow  in  it.   The  results  show  a  time 
constant  of  B/K  =   27  sec,  which  is  much  higher  than  measured 
experimental  values. 
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Threshold  of  PerceTption.       Studies  of  human  perception  of 
angular  acceleration  indicate  the  phenomenon  of  threshold.   At 
the  threshold,  or  below  it,  the  existence  of  a  constant  input 
acceleration  for  prolonged  time  will  not  be  noticed.   Physically, 
the  threshold  is  associated  with  the  minimal  deflection  of  the 
cupula  which  will  lead  to  a  conscious  sensation  of  rotation. 
The  time  from  the  onset  of  the  input  until  it  is  perceived, 
the  latency  time,  will  be  a  function  of  the  magnitude  of  the 
input  vector,  and  the  dynamics  of  the  sensor. 

A  technique  utilizing  the  step  response  in  acceleration 
of  the  semicircular  canals  is  widely  accepted  as  a  subjective 
measurement  of  threshold  (32).   The  method  applies  a  known  con- 
stant angular  acceleration  to  the  subject  and  his  latency  time 
is  recorded.   The  step  response  of  the  semicircular  canals  to 
an  input  acceleration  about  the  vertical  axis  Y,  is 


6 (t)  =  a 


l2 


+ 


10  -  0.1 


,_  ,  -lot  ,„  -0.lt. 
(O.le     -lOe      ) 


=  a , 


(1  -  e 


-0.lt, 


(13) 


where  aj,  =  input  angular  acceleration,  °/sec  .   Consequently, 


if 


mm 


is  the  deviation  of  the  cupula  at  the  threshold. 
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^  n  n  O.It  ^  O.OIt^  ,  ,^  ., 

0^.   -  0.1a    T  (1 ^ +  ^ .  .  .)        (14) 

mm        I  ■,  z  b 

with  T  latency  time,  sec. 

The  product  ctj^T  is  called  by  van  Egmond  et    at.    the 
"Muelder  product,"  ^and  their  observations  showed  it  approxi- 
mately constant  and  equal  to  1.5  to  2.0°/sec  over  the  range 
1  to  5°/sec2.   If  the  "Muelder  product"  is  constant,  it  im- 
plies that  the  product  of  latency  time  and  input  acceleration 
will  remain  constant  for  a  certain  range  of  input  accelera- 
tions . 

However,  the  applicability  of  the  "Muelder  product"  is 
limited  to  regions  where  the  additional  terms  of  the  series 
in  Eq.  (14)  do  not  exceed  say  10  percent,  or  t  <_  2 . 5  sec. 
The  controversy  about  the  validity  of  the  product  for  accelera- 
tions about  the  threshold  when  latency  times  are  longer  than 
2.5  sec  is  indeed  well  founded  as  Eq.  (14)  shows  (47). 

The  validity  of  the  "Muelder  product"  over  the  range  of 
accelerations  from  0.1°/sec2  to  10°/sec2  was  tested  by  the  au- 
thor.  The  step  response  technique  for  measuring  threshold  of 
perception  was  used  to  measure  latency  time.   The  subjects, 
seated  in  a  hooded  cab  of  a  moving  base  simulator,  were  ad- 
ministered constant  angular  accelerations  about  the  earth-fixed 
vertical  axis  (Jg)  with  random  order  in  direction  and  magni- 
tude, six  readings  at  any  given  acceleration.   Headrest  and 
support  for  the  back  of  the  subject  kept  his  head  erect  under 
the  axis  of  rotation  and  with  no  strain  to  the  neck  muscles. 
Perceived  rotation  was  measured  by  a  "forced  choice"  method: 
the  subject  had  to  manipulate  a  control  stick  indicating  the 
direction  of  movement,  as  well  as  the  onset  of  his  subjective 
detection  of  rotation.   The  experimental  sequence  provided 
30  seconds  of  rest  between  consecutive  runs.   Three  subjects 
were  used  for  these  experiments. 

Figure  3.4  presents  the  experimental  results  averaged 
over  the  three  subjects,  along  with  the  expected  latency  time 
computed  from  Eq.  (14).   The  expected  latency  time  curve  was 
computed  relative  to  the  experimental  value  at  ay,  =  1.0°/sec^. 

A  perfect  agreement  between  latency  times  predicted  from  Eq. 
(14)  and  measured  values  is  found  over  the  region  of  angular 
accelerations  from  0.3  to  5°/sec2.   Near  the  threshold  (about 
0.14°/sec2  determined  on  75  percent  correct  identification  of 
input  direction) ,  the  departure  from  theoretical  results  is 
probably  due  to  scatter  in  the  data  caused  just  by  the  fact 
that  measurements  are  taken  near  the  limit  of  detection.   Simi- 
larly, when  latency  times  approach  the  response  time  of  the 
human,  the  experimental  data  shows  longer  latencies  than  pre- 
dicted.  Results  obtained  for  pilots  by  Clark  and  Stewart  (32) 
using  identical  techniques  are  also  presented  in  Figure  3.4. 
There  is  no  significant  difference  between  results  measured 
with  those  subjects  (pilots)  and  the  subjects,  with  no  flying 
experience,  used  here.   The  mean  latency  times  measured  here 
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are  also  presented  in  Figure  3.5.   Plotted  on  a  log-log  scale, 
the  "Muelder  product"  is  a  line  with  slope  of  -1.   Examination 
of  Figure  3.5  indicates  the  region  of  validity  for  this  product. 
As  noted  before,  the  product  ay,!  =  constant  is  not  a  valid  ap- 
proximation while  the  input  angular  accelerations  are  smaller 
than  1.0°/sec2.   Additional  terms  from  Eq.  (14)  improve  the  cor- 
respondence between  measured  and  expected  latency  times. 

On  the  basis  of  this  series  of  experiments,  the  following 
conclusions  are  justified: 
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1.  The  threshold  for  perception  of  angular  acceleration 
around  a  vertical  axis  will  vary  subjectively  between  0.1  and 
0.2°/sec2  with  a  mean  of  about  0.14°/sec2, 

2.  Latency  times  for  detection  of  small  accelerations  can 
be  predicted  accurately  from  the  model  for  the  semicircular 
canals . 

3.  For  its  range  of  validity  (t  <.  2.5  sec)  the  "Muelder 
product"  holds  with  somewhat  higher  value  (2.6°/sec)  than  usu- 
ally reported. 
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Figure    3,5.       Latency    Times    for   Perception    of  Angular 
Acceleration   About    the    Vertical    Axis    TYj-^j 


164 


Habituation 

Objective  measurements  of  the  semicircular  canals'  acti- 
vity by  recording  compensatory  eye  movements  and  subjective 
cupulograms  indicate  changes  in  response  due  to  frequent  stimu- 
lation.  The  phenomenon  is  called  habituation,  pointing  to  a 
variation  of  parameters  according  to  the  recent  history  of 
stimulation  for  the  canals.   Indeed,  the  question  is  raised 
whether  certain  characteristics  of  the  sensors  measured  at  any 
given  time  are  not  heavily  influenced  by  the  experimental  meth- 
ods used  to  obtain  these  results. 

Differences  are  reported  between  subjective  cupulograms 
and  cupulograms  for  objective,  compensatory  eye  movements. 
Moreover,  the  habituation  effect  becomes  pronounced,  for  a  given 
technique,  while  the  experimental  pattern  is  repeated  several 
times.   For  the  vestibular  system,  the  output  vector  has  been 
defined  here  as  subjective  perception  of  angular  velocity.   Sim- 
ilarly, the  focus  should  be  on  time  variations  found  for  the 
parameters  of  the  semicircular  canals  measured  by  subjective 
indication.   Values  for  B/K   obtained  by  the  repetitive  technique 
of  subjective  cupulometry  show  B/K   =  8  to  10  sec  (77) .   Those 
observations  will  pertain  as  long  as  the  semicircular  canals 
are  not  exposed  to  continuous  stimulation  lasting  for  several 
hours,  at  which  time  a  gradual  decrease  of  the  time  constant 
is  found  {11).      However,  a  period  of  rest  restores  the  cupulo- 
gram  to  its  original  value,  regardless  of  the  level  reached 
prior  to  it.   This  evidence  is  sufficient  to  conclude  that  the 
physical  model  of  the  semicircular  canals  and  the  experimental 
values  attached  to  its  parameters,  represents  the  expected, 
average  response  of  a  human  living  in  an  environment  which  does 
not  impose  stimulation  beyond  "normal."   In  this  context,  normal 
stimulation  can  be  defined  as  exposure  to  rotations  necessitated 
by  everyday  life.   The  response  of  the  canals  is  probably  adapted 
to  living  conditions  on  earth,  similar  to  the  way  habituation 
takes  place  when  those  conditions  are  changed. 

Objective  cupulograms  measuring  the  velocity  of  the  slow 
phase  of  vestibular  nystagmus  find  B/K  =   16  sec.   Those  re- 
sponses will  hold  for  stimulation  periods  well  beyond  the  time 
when  effects  are  noticed  on  subjective  measurements.   However, 
for  professionals  with  constant  exposure  to  angular  accelera- 
tions, like  figure  skaters  and  pilots,  the  objective  cupulograms 
show  the  habituation  phenomenon  along  with  the  accompanying  re- 
covery from  it. 

The  habituation  to  stimulation  is  in  general  attributed 
to  the  central  nervous  system  (52,  77).   This  notion  on  habitu- 
ation is  supported  by  the  fact  that  compensatory  eye  movements, 
being  of  a  somewhat  reflex  nature,  do  not  adapt  easily.   In- 
deed, for  very  sensitive  subjects,  objective  and  subjective 
cupulograms  agree  numerically,  indicating  adapted  response  for 
most  of  the  subjects,  randomly  selected  (77).   Still,  neither 
the  mechanism  of  habituation  nor  the  periods  of  time  involved 
are  known. 
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Experiments  on  cats  stimulated  repeatedly  with  sinusoidal 
rotation  of  one  given  frequency  show  marked  habituation  of 
compensatory  eye  movements  to  this  particular  frequency  while 
effects  taper  off  for  the  adjacent  spectrum  of  frequencies  (41) . 
These  findings  support  the  notion  that  habituation  is  central, 
since  it  is  hard  to  attribute  mechanical  fatigue  of  the  canals 
to  a  certain  frequency  only.   However,  as  stated  before,  be- 
sides identifying  the  phenomenon,  no  control  description  can 
be  attached  to  it  yet. 

In  an  effort  to  overcome  the  effect  of  habituation  on  the 
long  time  constant  of  the  semicircular  canals,  Cawthorne  et   al . 
used  the  oculogyral  illusion  to  indicate  the  time  response  of 
the  cupula  in  response  to  an  impulse  of  angular  acceleration 
(18).   During  the  oculogyral  illusion,  a  light  which  is  sta- 
tionary with  respect  to  the  subject,  will  appear  to  him  as 
moving  with  him  in  the  direction  of  motion  of  the  subject. 
The  illusion  has  been  explained  to  be  due  to  the  compensatory 
eye  movements,  thus  acceleration  to  the  left  produces  eye  ro- 
tation to  the  right  and  an  accompanying  motion  of  the  visual 
target  opposite  to  it.   The  velocity  of  the  oculogyral  illusion 
in  response  to  an  impulse  of  acceleration,  as  obtained  by  Caw- 
thorne, shows  a  time  constant,  B/K   =  2  4  sec.   However,  at 
present  it  is  not  completely  clear  whether  the  oculogyral  il- 
lusion originates  solely  in  the  vestibular  system.   Therefore, 
parameters  measured  by  this  method  are  still  questioned. 

Rotation  About  a  Horizontal  Axis 

Investigators  have  assumed  that  the  torsion  pendulum  model 
for  the  cupula  deflection  is  valid  for  rotation  about  any  head 
axis.   However,  experimental  efforts  to  validate  this  assump- 
tion and  to  determine  the  time  constants  of  the  model  [see  Eq. 
(3)]  were  undertaken  almost  exclusively  for  rotation  around  the 
vertical  head  axis  (^/j)  .   The  deterrent  is,  of  course,  the  dif- 
ficulty to  produce  rotation  about  a  hori:^ontal  axis  (pitch  or 
roll)  without  stimulating  the  linear  motion  sensors  of  the  ves- 
tibular system. 

In  the  literature,  two  experiments  are  reported  to  measure 
the  long  time  constant,  B/K,    in  perception  of  rotation  about 
the  sagittal  and  the  lateral  axes  of  the  head  (102,  108).   Neith- 
er of  these  experiments  preserved  the  normal  head-neck  posture 
as  discussed  in  the  first  section;  thus  results  are  possibly 
affected  by  proprioception.   The  angular  accelerations  were  ap- 
plied about  the  earth-fixed  vertical  axis  with  the  head  tilted 
to  reach  the  proper  head  axis.   Jones  et   al .    recorded  by  subjec- 
tive cupulometry  for  roll,  {X]^)  {B/K)    =  6.1  sec,  and  for  pitch, 
(Z/j)  {B/K)    -   5.3  sec.   From  eye  movement  evaluation  of  response 
to  a  single  velocity  step  input,  the  corresponding  values  are 
B/K  =    6.6  sec  and  B/K   =   4.0  sec,  respectively  (102). 

With  a  similar  technique  of  stimulation,  Ledoux  used  the 
data  on  the  topography  of  the  vestibular  system  to  stimulate 
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each  coplanar  pair  of  canals  by  accelerations  about  an  axis 
perpendicular  to  its  mean  plane.   Objective  cupulometry  in 
planes  parallel  to  the  planes  of  the  canals  did  not  show  vari- 
ations of  characteristics  among  the  three  pairs  of  semicircular 
canals  (108) . 

No  data  on  the  short  time  constant  I/B   and  the  sensitivity 
of  the  canals  stimulated  in  pitch  and  roll  is  available.   Nev- 
ertheless, it  is  plausible  to  assume  them  as  equal  to  those  for 
rotation  in  yaw. 

Threshold   of   Perception    (Experiment    by    the   Author).       Using 
the  technique  of  applying  steps  of  angular  accelerations  and 
recording  the  latency  time  until  rotation  is  perceived,  the 
threshold  of  sensation  for  rotation  around  the  head  sagittal 
axis  (roll)  was  determined.   The  measured  latency  times  for 
perception  of  small  accelerations  were  used  to  obtain  the  long 
time  constant,  B/K,'   of  the  canals  sensitive  to  angular  accelera- 
tions about  this  axis. 

The  experimental  method  and  procedure  were  identical  to 
those  described  earlier.   The  point  to  note  is  that  the  simu- 
lator cab  was  rotated  about  the  earth-fixed  vertical  axis  (7g) . 
The  subject  seated,  was  accommodated  to  rest  his  head,  face 
down,  on  a  head  rest  under  the  axis  of  rotation  of  the  simulator. 
By  bending  the  body  at  the  waist  rather  than  the  neck,  the  "nor- 
mal" posture  of  head-neck,  or  a  position  within  a  few  degrees 
from  it  was  preserved  throughout  the  experiment. 

Under  these  circumstances,  the  vestibular  linear  motion 
sensors  were  not  stimulated  during  the  experiment  except  for 
the  steady  change  of  orientation  of  the  head  with  respect  to 
gravity.   The  tangential  and  centrifugal  accelerations  here  are 
below  the  threshold  of  these  sensors. 

The  experimental  results  are  presented  in  Figure  3.6. 
Threshold  of  perception  is  found  approximately  at  0.5°/sec'^ 
angular  acceleration  and  a  rather  sharp  separation  between  sen- 
sation and  lack  of  it  is  noted.   The  mean  latency  times,  aver- 
aged over  the  three  subjects  were  used  to  estimate  the  long 
time  constant  of  the  semicircular  canals  in  this  configuration. 
Making  the  assumption  that  the  short  time  constant  is  0.1  sec 
and  fitting  an  equation  of  the  form  of  Eq.  (14)  to  the  data 
yields  B/K  =   1    sec.   Latency  times  measured  in  these  experiments 
were  compared  with  results  from  responses  for  rotation  around 
the  vertical  head  axis  [Y]^)    and  the  difference  between  the  mean 
values  were  found  highly  significant  (P  <.  0.005)  for  accelera- 
tions lower  than  5.0°/sec2.   Assuming  the  short  time  constant 
of  the  sensors  as  0.1  sec  and  an  agreement  between  the  subjec- 
tive and  the  input  velocity  over  the  range  of  0.14  rad/sec  to 
10  rad/sec  will  yield  the  following  transfer  function: 

Subjective  angular  velocity  (s)  _ 


a^  is)  {Is    +  1)  (0.1s  +  1) 
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Figure    3.6.       Latency    Times    for   Peroe-ption    of  Angular 
Accelerations   About    the   Roll   Axis    TXj^j 

(Note:  Scale  change  of  angular  acceleration.) 


A  Mathematical  Model  for  the  Semicircular  Canals 

The  experimental  data  presented  in  this  chapter  reflects 
certain  characteristics  of  the  semicircular  canals  which  can 
support  a  state  of  knowledge  mathematical  model  for  this  portion 
of  the  vestibular  system  (8).   The  block-diagram  in  Figure  3.7 
shows  the  dynamic  characteristics  of  the  canal  system  and  the 
physiological  organs  to  which  they  are  attributed.   Angular  ac- 
celerations measured  in  the  earth-fixed  frame  (ag)  are  resolved 
into  components  in  the  head  axis  system  by  the  orientation  ma- 
trix [A]  ,    which  is  dependent  upon  the  orientation  of  the  skull. 
In  the  semicircular  canals,  stimulated  by  the  input  accelera- 
tion, the  cupula  deviates  from  its  null  position  in  agreement 
with  the  highly  damped  second  order  model.   When  the  cupula 
deviation  exceeds  the  threshold  level,  this  information  is 
picked  up  by  the  central  nervous  system  to  be  interpreted  con- 
sciously as  subjective  angular  velocity.   Note  that  this  model 
is  not  representing  characteristics  of  any  given  canal,  neither 
is  it  associated  with  stimulation  of  physiological  synergic 
(acting  together)  pairs,  but  outlining  perception  of  accelera- 
tions in  the  head  axis  system  as  defined  in  the  second  section. 
As  presented  here,  the  dynamics  of  the  canals  associated  with 
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perception  of  angular  accelerations  about  the  X]^   and  Zf^   axes 
(roll  and  pitch)  are  assiamed  to  be  equal.   The  central  nervous 
system,  CNS ,  is  shown  here  as  a  block  F(s)  to  underline  the  fact 
that  certain  unknown  transfer  characteristics  are  associated 
with  it.   As  discussed  previously,  habituation  is  a  control 
process  attributed  to  CNS.   When  the  semicircular  canals  are  not 
affected  by  excessive  stimulation,  the  perceived  sensation  of  ro- 
tation is  assumed  to  depend  entirely  upon  the  canal  dynamics 
thus  rendering  F {s)    =  1. 

What  is  the  physical  vector  that  corresponds  to  the  subjec- 
tive perception  of  angular  velocity?   This  question  is  concerned 
with  the  mental  evaluation  of  information  provided  by  the  semi- 
circular canals.   Figure  3.8  is  the  frequency  response  of  the 
canals  (Bode  plot)  for  rotation  about  the  vertical  head  axis  {Y-j^) 
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with  the  input  vector  being  the  angular  velocity  of  rotation 
and  the  output  is  the  subjective  perception  of  angular  velocity 
assumed  proportional  to  the  cupula  deflection.   Note  that  over 
a  wide  range  of  frequencies,  namely  0.1  to  10  rad/sec,  the  sub- 
jective sensation  is  that  of  the  angular  velocity  of  the  motion. 
Similar  observations  hold  for  perception  of  angular  velocities 
about  the  horizontal  axes  although  with  a  slightly  condensed 
frequency  range,  thus  rendering  the  semicircular  canals  as  angu- 
lar velocity  meters  over  most  of  the  frequency  spectrum  of  head 
movements  during  everyday  activity.   Moreover,  while  a  rotation 
with  constant  angular  velocity  will  go  unperceived  by  the  canals, 
a  constant  angular  acceleration  motion  will  be  sensed  over  a 
certain  period  of  time  in  a  manner  that  perception  will  coincide 
with  the  instantaneous  angular  velocity  of  the  rotation.   Equa- 
tion (13)  shows  that  cupula  deviation  will  be  proportional  very 
closely  to  the  instantaneous  angular  velocity  (a^t)  for  the  first 
6  to  8  seconds  after  applying  the  input  acceleration.   Whether 
the  CNS  is  capable  to  add  vectorially  signals  arriving  from  the 
canals  when  the  input  acceleration  is  about  an  intermediate  axis 
of  the  canals  is  still  an  open  question.   Qualitative  measure- 
ments of  compensatory  eye  movements  indicate  a  positive  answer; 
however,  subjective  perception  might  differ  in  this  aspect. 

The  validity  of  the  control  model  and  the  use  of  it  has  to 
be  viewed  in  light  of  the  limitations  one  has  to  impose  due  to 
insufficient  experimental  support: 

1.  Dynamic    Range.      Equation  (1)  shows  that  for  a  step  in- 
put the  steady  state  deviation  of  the  cupula  is  equal  numerically 
to  the  input  angular  acceleration.   However,  the  morphological 
structure  of  the  semicircular  canals  and  the  basic  assumption  on 
the  cupula  sealing  the  ampulla  in  its  deviated  position  will 
probably  limit  the  range  of  cupular  travel  within  ±30°.   Thus  a 
dynamic  range  of  about  100  to  15  0  for  accelerations  about  the  7^ 
axis  (from  0.2°/sec2  to  30°/sec2)  and  somewhat  smaller  range  for 
accelerations  about  the  X]^   and  the  Z/^  axes  are  reasonable  to  ex- 
pect from  these  sensors  while  remaining  within  their  linear  char- 
acteristics . 

2.  Habituation.      The  phenomenon  has  considerable  effect  on 
subjective  perception  of  rotation.   Also,  perceived  estimates  of 
angular  velocity,  but  not  compensatory  eye  movements,  have  been 
found  to  decline,  contrary  to  the  model  prediction,  when  an  input 
acceleration  persisted  for  periods  longer  than  30  sec  (86)  .  Thus 
the  model  is  valid  for  short  lasting  rotations  (about  10  sec)  and 
limited  to  moderate  periods  of  stimulation  which  do  not  cause 
substantial  habituation. 

Within  the  outlined  reservations,  the  control  engineering 
model  for  the  semicircular  canals  and  its  associated  parameters 
is  a  complete  set  of  specifications  on  those  sensors. 
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4.    THE  OTOLITHS— LINEAR  ACCELERATION  SENSORS 

The  perception  of  the  orientation  of  the  head  (and  the 
body)  in  space,  relative  to  the  force  fields  of  the  environ- 
ment, is  universally  considered  to  be  the  function  of  the 
otolithic  organs.   Accordingly,  the  presence  of  specific 
forces  acting  on  the  body  in  its  coordinate  system  is  the 
input  to  the  subjective  feeling  of  orientation  provided  by 
these  sensors.   On  a  higher  level,  the  otoliths  regulate  the 
postural  reflexes  of  the  body  and  the  counterrolling  compensa- 
tory eye  movements  which  preserve  the  appropriate  equilibrium 
in  a  given  spatial  attitude.   In  all,  the  otolithic  organs 
are  a  center  of  detection  and  control  of  the  voluntary  changes 
of  posture  along  with  monitoring  orientation  during  passive 
maneuvers  of  the  head  and  the  body  as  a  whole. 

However,  despite  the  vital  importance  of  the  sensor,  lit- 
tle was  known  about  its  dynamic  characteristics  and  expected 
response  to  specific  stimulation.   The  following  discussion 
will  attempt  to  unify  the  information  scattered  in  the  litera- 
ture with  experimental  results  obtained  by  the  author  into  a 
concise  control  engineering  model  of  the  utricle  otoliths. 

The  Utricle  and  the  Saccule 

The  anatomical  structure  of  the  labyrinth  in  a  human  re- 
veals two  pairs  of  otolithic  organs,  the  utricle  and  the  sac- 
cule.  (See  Fig.  2.1.)   The  structure  is  characterized  by  a 
nonmoving  part,  the  macula,  and  the  sliding  otoliths.   It  is 
the  movement  of  the  heavy  otolith  over  the  macula  which  gives 
rise  to  the  perceived  sensation  of  tilt  or  motion. 

The  specific  function  of  each  of  the  two  otolithic  organs 
in  motion  sensing  has  been  the  subject  of  extensive  research 
effort.   In  mammalians,  physiological  studies  of  reflexes  and 
recording  of  firing  rate  from  the  utricle  branch  of  the  vesti- 
bular nerve  demonstrate  activity  for  stimulation  with  linear 
accelerations  (1) .   No  similar  nerve  response  to  accelerations 
has  been  measured  from  the  saccule.   A  specific  study  aimed  to 
investigate  its  activity  concludes  with  the  statement  that  the 
saccule  is  probably  associated  with  auditory  sensation  of  vibra- 
tions (126).   However,  some  authors  still  do  not  exclude  the 
saccule  as  a  motion  sensor  (130).   In  general,  incorporation 
of  the  saccule  as  an  orientation  sensor  has  been  required  due 
to  the  inadequate  knowledge  of  the  stimulation  process  of  the 
utricle.   On  the  basis  of  the  exiscing  experimental  evidence, 
the  utricle  should  be  recognized  as  the  only  otolithic  sensor 
stimulated  by  linear  accelerations. 

The  Utricle — Sensor  Characteristics 

The  effort  to  describe  the  sensor  characteristics  of  the 
utricle  concentrated  on  studies  of  comparative  physiology  in 
mammalians,  and  orientation  experiments  with  humans.   In 
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animals,  in  particular,  cats,  recordings  of  nerve  firing  iden- 
tified the  input  vector  causing  stimulation  of  the  otolith  (the 
term  "otolith"  will  be  used  here  for  the  "utricle  otolith")  as 
tilt  away  from  the  vertical  (1,  40). 

In  a  fish,  electronic  microscopy  showed  an  arrangement  of 
sensory  hairs  with  preferred  axis  of  stimulation  forming  a  semi- 
circle (163).   This  finding  might  indicate  that  input  vector 
resolution  is  possible  according  to  the  location  of  the  sensory 
hair  (or  hairs)  from  which  nerve  firing  was  received.   One  can 
compare  this  structure  of  the  utricle  to  a  sensor  covered  with 
a  lattice  of  strain  gages  where  the  input  magnitude  is  obtained 
by  measuring  the  gage  with  the  maximum  output.   The  spatial  lo- 
cation of  the  strain  gage  will  deterroine  the  direction  of  the 
input  acceleration. 

Since  subjective  perception  of  inclination  with  respect  to 
the  gravity  vector  persists  as  long  as  this  orientation  is 
maintained,  the  otoliths  were  designated  as  static  receptors. 
The  implication  is,  of  course,  that  the  utricle  is  stimulated 
by  changes  of  the  head  attitude,  thus  providing  a  sense  of  angu- 
lar position,  while  this  indication  is  only  transient  for  the 
semicircular  canals. 

The  distinction  between  the  gravity  field  and  accelera- 
tions in  any  coordinate  system  is  impossible  to  make.   One  can 
argue  here  that  the  utricle  is  a  specific  force  receptor,  where 
specific  force  is  the  vectorial  difference  of  the  gravity  vec- 
tor and  other  intermittent  accelerations.   Following  this  broad 
definition,  linear  acceleration  per  se ,  without  restriction  on 
its  source,  is  considered  the  input  variable  for  the  otolithic 
sensor.   Accordingly,  exposure  to  centrifugal  or  linear  accelera- 
tion as  well  as  corriolis  forces  will  be  interpreted  by  the  hu- 
man as  reorientation  with  respect  to  the  gravity  vector,  pro- 
vided other  sensors  or  sensory  systems  do  not  supplement  the 
perceived  sensation. 

The  theory  of  operation  for  the  utricle  and  its  otolith 
conceals  the  key  to  evaluation  of  several  related  characteris- 
tics of  the  sensor.   Is  the  otolith  an  omnidirectional  vector 
sensor  informing  on  magnitude  and  direction,  or  just  a  direc- 
tional transducer? 

Topologically ,  for  an  erect  head,  the  utricles  are  located 
on  a  plane  which  is  elevated  about  30°  above  the  horizontal 
plane.   Although  the  macula  and  the  otolith  are  not  strictly 
planar,  most  investigators  treat  them  as  such  (130,  151).   The 
theories  put  forth  to  explain  the  stimulation  causing  the  oto- 
lith displacement  range  from  pull  or  traction  (45) ,  pressure 
(145),  or  gliding  movement  (13). 

While  de  Kleyn  supported  the  notion  of  force  perpendicular 
to  the  otolith  as  the  stimulus,  Quix  explained  it  by  the  weight 
of  the  otolith,  and  Breuer  implied  that  the  sensor  is  respond- 
ing to  the  direction  of  the  shear  force  parallel  to  the  macula 
plane  but  not  to  its  magnitude.   Recently,  the  shear  principle 
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has  been  rather  universally  accepted  as  the  mode  of  operation 
for  the  utricle. 

Sufficient  experimental  evidence  exists  to  support  the 
following  statements  on  the  otolithic  organs: 

1.  The  utricle  is  a  multidirectional  sensor  sensitive 
to  specific  force. 

2.  The  utricle  is  stimulated  by  the  shear  acceleration 
in  the  plane  of  the  otolith. 

These  statements  imply  that  perception  of  the  input  vari- 
able is  in  vectorial  form;  not  only  the  direction  of  the  field 
force  is  perceived,  but  also  its  strength. 

In  humans,  mostly  attempts  to  evaluate  static  or  steady 
state  conditions  of  perception  of  orientation  were  undertaken. 
The  perceptual  phenomenon  of  tilting  surroundings  one  experi- 
ences when  subjected  to  variations  of  the  resultant  force  in 
his  head  axes  system  has  been  designated  as  the  oculogravic 
illusion  (11) .   The  phenomenon  is  a  very  useful  tool  to  mea- 
sure subjective  orientation  (location  of  the  vertical  or  the 
horizontal  relative  to  the  actual  physical  inclination) .   An- 
other experimental  procedure  uses  the  human  ability  to  locate 
the  gravity  vector  when  tilted  in  the  frontal  plane. 

The  objective  measurements  of  otoliths  output  is  record- 
ing of  compensatory  counterrolling  eye  movements  (130,  160). 
Dependence  of  those  eye  movements  upon  the  magnitude  of  resul- 
tant acceleration  has  been  demonstrated  for  increased  gravita- 
tional and  1.0  g  gravity  field  (173). 

Static  measurements  of  the  subjective  horizon  for  varying 
elevation  of  the  head  axes  system  (discrete  rotations  around  Z 
axis)  render  linear  correlation  of  perception  with  the  shear 
acceleration  on  the  utricle  (151).   (See  Fig.  4.1.)   For  an 
erect  head,  the  shear  on  the  macula  is  along  an  axis  elevated 
about  20°  above  the  sagittal  axis.   Consequently  the  subjective 
horizon  will  correspond  to  the  actual  horizon  for  0.4  g  back- 
ward shear  acceleration  on  the  otoliths.  .  The  measurements 
confirm  the  assumption  that  sensation  is  dependent  upon  the 
magnitude  of  the  shear  acceleration,  since  there  is  a  linear 
relationship  between  shear  and  subjective  perception.   Experi- 
mentally this  relationship  is  valid  for  ±90°  of  bending  fore 
and  aft.   However,  incomplete  or  rather  erroneous  spatial  ori- 
entation is  suggested  by  the  slope  of  the  line  in  Figure  4.1. 
Nevertheless,  the  sensor  is  responding  to  acceleration  changes 
in  the  sagittal  plane  in  agreement  with  its  assumed  character- 
istics. 

Tilt  in  the  frontal  plane  is  associated  with  perception 
of  the  vertical  when  only  gravity  is  present  or  perception  of 
the  resultant  vector  for  exposure  to  gravity  and  linear  accelera- 
tions.  Psychophysical  experiments  show  equal  ability  for  re- 
orientation without  directional  dependence  (123) .   The  observa- 
tion confirms  the  expected  symmetry  of  perception  in  the  frontal 
plane,  a  feature  deduced  on  the  basis  of  the  structure  of  the 
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Dynamic    Response    of   the    Otoliths .       The  important  contri- 
bution of  the  utricle  in  space  orientation  is  the  continuous 
monitoring  of  body  attitude  relative  to  the  environmental 
forces.   However,  the  extent  of  orientation  information  ori- 
ginating at  this  sensor  cannot  be  fully  evaluated  without  a 
detailed  knowledge  of  its  dynamic  characteristics.   Intermedi- 
ate sensations  the  human  will  perceive  during  transfers  from 
one  postural  orientation  to  another,  or  during  exposure  to 
intermittent  linear  accelerations  are  a  function  of  the  sen- 
sor's dynamics.   Basically,  the  questions  are  what  physical 
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vector  the  otolithic  organ  senses  when  it  is  repeatedly  stimu- 
lated with  a  certain  time  varying  pattern  of  acceleration,  and 
what  is  the  frequency  response  of  the  otolith? 

The  theory  of  control  engineering  shows  that,  in  a  minimum 
phase  linear  system,  input-output  relations  are  defined,  except 
for  a  gain  constant,  by  either  the  phase  difference  between  out- 
put and  a  sinusoidal  input  or  by  the  ratio  of  their  respective 
amplitudes.   Therefore,  the  dynamic  characteristics  of  a  linear 
system  are  fully  determined  in  the  transformed  frequency  domain 
when  its  response  is  tested  over  a  significant  range  of  input 
frequencies. 

The  utricle  has  been  identified  as  a  sensor  with  linear 
characteristics  when  linear  accelerations,  within  the  range  of 
±1.0  g   of  shear  acceleration  on  the  otoliths,  are  applied  in 
the  sagittal  plane.   (See  Fig.  4.1.)   Consequently  an  experi- 
ment which  compares  the  phase  relationship  between  the  subjec- 
tive perception  of  velocity  and  the  input  velocity  or  accelera- 
tion is  admissible  for  valid  testing  of  the  frequency  response 
of  the  otoliths. 

a.  Method:  A  linear  motion  simulator  was  used  for  the  ex- 
periment.  The  subject  is  seated  upright  with  his  sagittal  axis 
horizontal  and  along  the  direction  of  motion.   His  head  is  sup- 
ported on  a  head  rest  and  his  body  strapped  firmly  to  the  chair, 
The  simulator  is  driven  back  and  forth  along  the  track  with  a 
single  frequency,  sinusoidal  function.   Perception  of  the  sub- 
ject is  communicated  by  a  displacement  of  a  light,  spring- 
restrained,  stick.   Following  preexperimental  instructions, 

the  subject  indicates  only  the  direction  of  motion  he  under- 
goes.  Position  of  the  simulator  along  the  track  and  subject 
indication  were  continuously  recorded  on  a  paper  recorder 
throughout  the  experiment.   Three  subjects  with  previous  ex- 
perience in  psychophysical  studies  were  used  for  this  study. 

b.  Results:  The  frequency  response  of  the  utricle  was 
examined  over  the  range  of  0.02  cps  to  0.9  cps  at  discrete  in- 
crements of  0.01  cps  for  the  low  frequencies  and  steps  of  0.1 
cps  for  the  high  frequency  end.   The  profile  of  peak  accelera- 
tion for  the  experiment  is  given  in  Figure  4.2,  the  decline 

of  it  below  0.1  cps  being  due  to  the  limited  length  of  the 
track.   Since  the  subjects  were  instructed  to  indicate  the  di- 
rection of  their  movement,  their  response  during  one  cycle  of 
back  and  forth  oscillation,  at  any  given  frequency,  resembled 
a  square  wave  with  a  "dead  zone"  of  no  indication  whenever  the 
stimulus  fell  below  the  individual  threshold  of  perception. 
The  operator's  response  is,  of  course,  his  subjective  percep- 
tion of  velocity.   The  phase  angle  this  subjective  velocity 
lags  or  leads  the  input  velocity  is  presented  in  Figure  4.3. 
Intersubject  differences  in  phase  angle  data  were  not  statis- 
tically significant  (P  >  0.1).   Thus  results  from  the  three 
subjects  were  pooled  with  mean  values  at  each  frequency  shown 
in  Figure  4.3.   One  standard  deviation  of  phase  angle  at  any 
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given  frequency  did  not  exceed  2°.   Examination  of  the  phase 
angle  for  perception  of  subjective  velocity  reveals  that  at 
low  frequencies,  it  leads  the  input  velocity,  at  about  0.4  0 
rad/sec  it  is  in  phase  with  it  and  beyond  that  frequency,  hu- 
man perception  lags  behind  the  input  velocity.   The  response 
is  typical  of  second  order  systems  with  time  constants  Ti_   - 
10  sec,  ^2  ~  0.66  sec.   This  theoretical  curve  fit  with  break 
frequencies  at  w\   =  0.1  rad/sec  and  W2   =   1.5  rad/sec  is  the 
solid  curve  in  Figure  4.3.   The  phase  lag  associated  with  the 
second  order  system  is  in  good  agreement  with  the  experimental 
results.   In  view  of  this  finding,  an  assumption  is  made  here 
that  the  dynamic  characteristics  of  the  utricles  are  repre- 
sented by  a  linear  second  order  characteristic  equation.   The 
transfer  function  from  input  acceleration  to  subjective  sensa- 
tion of  velocity  will  take  the  form  of 

subjective  velocity  (s)  _  K n  r 'i 

a„  (s)  (10s  +  1)  (0.66s  +  1)       ^       ' 

e 

where  a„   =  linear  acceleration  along  the  horizontal  earth- 

e 
fixed,  X      axis.   The  frequency  response  of  the  otoliths  from 

an  input  velocity  along  the  X^    axis  to  subjective  velocity  is 

shown  in  Figure  4.4.   Note  that  the  gain  constant  K   has  not 

been  measured. 

Threshold   of  Perception.    Threshold  of  perception  for  the 
utricle  is  significant  in  terms  of  minimum  deviation  in  ori- 
entation detectable  by  the  sensor.   If  threshold  is  associated 
with  minimum  displacement  of  the  otolith,  the  latency  time  to 
detect  input  acceleration  of  a  certain  magnitude  will  corres- 
pond to  the  duration  of  travel  of  the  otolith  from  rest  posi- 
tion to  the  threshold  deflection.   Consequently,  the  threshold 
of  the  utricle  is  defined  as  the  minimum  acceleration  which 
the  sensor  will  detect  provided  the  stimulus  persisted  for  a 
sufficiently  long  period.   For  the  otolithic  organ,  measure- 
ments of  threshold  and  latency  times  in  the  sagittal  plane 
were  undertaken. 

a.   Method:  Again  a  linear  motion  simulator  was  used  for 
these  series  of  experiments.   The  subject,  with  strapped  body 
and  supported  head,  was  accommodated  in  two  positions:  {1)    seat- 
ed upright  facing  the  direction  of  motion;  (2)  lying  supine 
with  his  longitudinal  body  axis  along  the  track.   The  simu- 
lator was  given  a  step  in  acceleration  maintained  until  the 
subject  indicated  perception  of  motion.   Directions  (backwards 
or  forwards)  and  magnitudes  of  acceleration  were  randomized 
with  the  only  provision  of  demanding  at  least  four  responses 
for  each  input  acceleration.   Thirty  seconds  of  rest  or  more 
were  allowed  between  consecutive  runs  with  the  whole  series 
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Figure    4.4.       Bode    Plot    of   Otoliths   Model 

lasting  for  less  than  one-half  hour.   The  measurements  for  the 
upright  and  the  supine  position  were  taken  on  two  consecutive 
days,  while  the  order  changed  among  the  three  subjects  used  in 
the  experiments. 

b.   Results:  The  response  of  the  model  for  the  otoliths 
to  a  step  of  acceleration  is  given  by 

subjective  perception  (t)  =  a^   K{1   +  0 .  OVe"-'' "  ^*-l.  07e~  '   )  (16) 
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If  we  associate  the  physical  vector  of  displacement  of  the  oto- 
liths with  subjective  perception,  the  threshold  will  correspond 
to  some  minimum  travel  dj,^in  such  that 


mm 


-1  5t       -0  It 
=  a^    K{1    +  O.OVe   '   -l.OVe  ^--l^) 

A 

e 


(17) 


with  a  unique  relation  between  the  latency  times  t  measured  and 
the  magnitude  of  the  input  acceleration,  ax    • 

Two  immediate  observations  are  apparent  from  Eq.  (16): 
(1)    the  effect  of  the  term  0 .  07e~-'- •  ^""^  ,  drops  off  almost  com- 
pletely after  one  second;  (2)  a  very  slow  increase  of  the  factor 
multiplying  the  input  acceleration  during  the  first  second.   One 
can  expect  then  that  a  wide  range  of  accelerations  will  be  per- 
ceived with  latency  times  of  about  one  second. 

Figure  4.5  represents  the  mean  latency  times  of  the  three 
subjects  for  the  supine  position  as  a  function  of  input  accel- 
eration.  The  solid  line  is  the  theoretical  curve  from  Eq.  (17) 
referred  to  the  experimental  measurement  at  0.01  g.    An  excel- 
lent agreement  between  experimental  results  and  theoretical 
prediction,  over  the  whole  range  covered  in  the  experiment,  is 
noticed.   It  should  be  added  that  the  standard  deviation  for  any 
single  time  measurement  did  not  exceed  0.2  sec. 
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Figure    4.5.       Latency    Times    for   Perception   of  Horizontal 
Linear   Acceleration,    Supine 
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Figure  4.6  shows  the  experimental  latency  times  for  the 
seated  upright  position.   Note  that  according  to  the  shear  the- 
ory there  is  a  difference  of  shear  accelerations  between  the 
supine  and  the  upright  experimental  positions.   Since  measure- 
ments of  acceleration  along  the  earth-fixed  X^    axis  were  made, 
the  shear  acceleration  on  the  otoliths  (assumed  30°  elevated 
above  the  sagittal  axis)  is 


0.86  6  ng'  =   a      upright 


0.500  ng      =   a      supine 

^  e  o         ^ 


(18) 


where  ng^   =   input  acceleration  along  X^    axis  and  a^   =  shear  ac- 
celeration on  the  otoliths. 

Using  these  relations  and  the  theoretical,  expected  latency 
times  for  the  upright  position  were  computed  and  are  shown  as 
the  solid  line  on  Figure  4.6. 

The  thresholds  of  perception  for  the  otoliths,  based  on 
75  percent  correct  vector  detection,  are  0.01  g    for  supine  head 
and  0.006  g    for  upright  head. 


o 


0,    5 

E 


o    2 


0 


—  Model    Prediction,  Eq.  4.4  and  Eq.4.5 
I   Experimental     Data    with 
One   Standard    Deviation 


-  I 


K 


s. 


.01 


.03     .05     .07 
Acceleration  (g) 


.09 
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Review  of  Supporting  Publications .  The  experimental  pro- 
gram undertaken  by  the  author  was  sufficient  to  determine  the 
dynamic  characteristics  of  the  otoliths,  and  the  nonlinearity 
associated  with  the  threshold.  The  results  are  for  perception 
of  linear  motion  along  the  sagittal  axis.  Supporting  evidence 
to  these  findings  is  found  in  behavioral  experiments  reported 
in  the  literature. 

Researchers  working  on  motion  sickness  find  particular 
susceptibility  to  it  with  linear  motion  around  the  frequencies 
1/4  to  1/3  cps  (109).   For  the  high  frequencies,  the  attenua- 
tion in  dynamics  of  the  otoliths  indeed  serve  as  a  limiter  on 
the  input  accelerations  while  for  frequencies  below  1/4  cps; 
probably  equipment  limitations  on  maximum  acceleration  is  the 
cause  for  absence  of  sickness. 

The  parallel  swing  produces  linear  acceleration  stimuli, 
together  with  some  angular  acceleration  which  depends  upon  the 
length  of  the  suspending  wires.   Thus,  although  the  method  is 
not  absolutely  free  of  interacting  semicircular  canals  and  oto- 
liths stimulation,  measurements  with  it  might  be  of  limited  use. 

The  threshold  of  perception  was  measured  with  sinusoidal 
stimulation  on  a  swing  by  Walsh  (159).   For  a  supine  subject, 
he  reports  threshold  of  0.009  g    to  0.012  g.       However,  an  attempt 
to  determine  latency  times  on  the  swing  did  not  render  results 
which  are  compatible  with  other  measurements  by  the  same  author. 
Also  his  attempt  to  determine  phase  relations  between  the  sub- 
ject indication  and  the  actual  motion  did  not  render  compatible 
values  with  this  study.   This  is  probably  due  to  the  fact  that 
peak  accelerations  on  the  swing  were  very  close  to  the  threshold. 

The  best  observation  of  the  function  of  the  otoliths  which 
also  illustrates  the  scope  of  information  the  otoliths  will  pro- 
vide in  an  altered  environment  was  made  with  a  submerged  sub- 
ject in  a  rotating  tank  full  of  water  (155) .   The  subject 
seated,  was  rotated  with  the  tank,  head  over  heels  about  his 
Z;j  axis  at  constant  angular  velocity.   The  force  acting  on  the 
otoliths  is  gravity.   Therefore,  the  shear  acceleration  on  the 
otoliths,  for  this  maneuver,  is 

a      -   g    sin  oit^  (19) 

where  w  =  angular  velocity  of  the  tank.   The  perceived  sensa- 
tion if  illustrated  in  Figure  4.7  taken  from  Ref.  155.   Sub- 
jectively, the  motion  is  interpreted  as  riding  a  Ferris  wheel 
with  varying  amplitudes.   First,  why  the  Ferris  wheel  sensa- 
tion?  On  a  Ferris  wheel,  which  rotates  with  constant  angular 
velocity,  the  shear  acceleration  on  the  otoliths  is  combined 
from  gravity  and  the  centrifugal  acceleration.   Assuming  the 
rider  keeps  his  head  erect  (otoliths  plane  about  3  0°  above  the 
horizontal  plane) ,  the  shear  acceleration  on  the  otoliths  is 
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a 


=    {q   +    Hi,    R   sin  00,^)  sin  t^)  (20) 

0^1         1        12 

where  uo-,  =  angular  velocity  of  the  Ferris  wheel  and  R  =   radius 

of  the   Ferris  wheel. 

Note  that  except  for  an  additive  constant  acceleration 
{1   g) ,    the  shear  acceleration  for  the  two  cases  have  similar 
time  patterns.   Therefore,  in  absence  of  any  other  motion  clues 
to  the  undergoing  motion  (tumbling  head  over  heels) ,  the  sub- 
ject will  interpret  it  in  terms  of  a  commonly  experienced,  sim- 
ilar sensation--the  Ferris  wheel.   It  is  important  to  stress 
the  point  here  that  the  semicircular  canals  do  not  provide  ro- 
tational information  for  both  circumstances  since  the  motion 
is  with  constant  angular  velocity. 

The  second  observation  is  about  the  tendency  to  feel  only 
plunging,  up  and  down  motion  with  increase  in  angular  velocity. 
According  to  the  Bode  plot  for  the  otoliths,  sensation  is  at- 
tenuated with  4  0  db  per  decade  beyond  1/4  cps.   Thus  increas- 
ing portions  of  the  rotation  will  pass  unnoticed  because  the 
shear  acceleration  dropped  below  the  threshold  with  the  limit- 
ing case  of  only  peaks  being  sensed.   Since  the  maximum  forces 
on  the  Ferris  wheel  are  indeed  at  the  top  and  the  bottom  of  the 
loop,  the  interpretation  forwarded  by  the  subject  is  consistent 
with  previous  experience.   Significantly  enough,  the  departure 
from  a  circular  pattern  for  the  Ferris  wheel  occurs  at  20  rpm 
(1/3  cps) ,  close  to  the  1/4  cps  break  frequency  of  the  otoliths 
found  here. 


(a)  0  to  20  rpm.         (b)  20  to  55  rpm   (c)55to60rpm 

Figure    4.7.       Illustration    of  Motions    Sensed   by    Seated   Subject    (155 
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Habituation 

The  utricle  is  often  referred  to  as  a  statolithic  organ, 
indicating  its  sensitivity  to  static  changes  of  orientation  of 
the  head  with  respect  to  the  vertical.   In  this  context,  one 
would  expect  then  little  or  no  attenuation  in  perception  due 
to  frequent  stimulation.   Otherwise  the  monitoring  capability 
of  the  sensor  is  to  no  avail.   A  comparative  study  of  pilots  and 
subjects  with  no  flying  experience  indeed  finds  no  significant 
difference  between  the  groups  in  their  ability  to  orient  them- 
selves (10,  11).   While  long  term  habituation  is  excluded  logic- 
ally, it  does  not  inhibit  diminution  of  sensitivity  to  a  new 
steady  state  level  compatible  with  the  input  acceleration. 
In  cats,  a  shifted  otolith  will  show  action  potentials  at  a 
frequency  proportional  to  the  tilt  and  then  the  frequency  dur- 
ing the  following  30  seconds  will  settle  down  to  a  constant 
value  which  is  about  60  percent  of  the  original  (1) .   Subjec- 
tive experiments  in  humans  found  that  readjustments  to  the 
gravity  vector  are  significantly  more  accurate  immediately  after 
the  tilt  compared  to  readings  after  60  seconds  of  stay  in  tilted 
position  (123).   Moreover,  the  amount  of  adaptation  in  this  ex- 
periment is  of  the  order  of  60  percent  of  the  initial  angle  of 
tilt.   These  findings  are  supported  independently  by  additional 
experiments  which  show  the  effect  of  angular  rate  upon  read- 
justment but  almost  no  influence  of  the  period  of  exposure  to 
the  tilt  if  longer  than  30  sec  (57) .   A  summary  stating  that  a 
short  term  adaptation  of  subjective  perception  takes  place  dur- 
ing 30  seconds  is  justified,  but  the  data  is  not  sufficient  to 
put  forward  a  control  theory  description  of  it. 

Mathematical  Model  for  the  Otoliths 

The  experimental  results  obtained  by  the  author  were  from 
investigations  of  the  otoliths'  function  in  perceiving  linear 
accelerations  along  the  Xq    axis.   By  correlating  the  data  of 
the  upright  position  with  the  supine  one,  it  is  evident  that  a 
unified  presentation  holds  for  any  head  orientation  within  the 
range  of  ±90°  rotation  of  the  head  frame  about  the  horizontal, 
earth-fixed  axis  Zg.   Observations  by  other  researchers  indi- 
cate the  probability  of  similar  response  of  the  otoliths  for 
lateral  tilt.   Thus  one  can  speculate  that  the  missing  link  in 
the  control  engineering  description  of  the  otoliths  is  the 
mechanism  performing  vectorial  manipulations  and  not  the  dy- 
namics of  the  sensors.   Incidentally,  this  mechanism  of  direc- 
tional resolution  will  have  effect  only  on  the  sensitivity  of 
the  otoliths.   The  mathematical  model  of  the  otoliths  is  pre- 
sented in  Figure  4.8.   In  this  model,  the  specific  force  in 
earth-fixed  coordinates  is  resolved  to  components  in  the  plane 
of  the  utricle  and  perpendicular  to  it  by  the  orientation  ma- 
trix and  the  alignment  matrix  [A    x  6] .   The  components  along 
the  plane  of  the  otoliths  constitute  the  shear  acceleration  on 
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the  otoliths.   This  acceleration  stimulates  the  otoliths, 
which  after  exceeding  the  threshold,  send  information  to  the 
central  nervous  system,  CNS ,  where  it  is  interpreted  as  sub- 
jective perception.   Some  unknown  transfer  characteristics 
have  to  be  assigned  to  the  CNS,  thus  F(s). 

The  dynamic  range  of  the  sensor  is  not  known  precisely; 
however,  it  is  at  least  100  or  more,  since  we  are  living  in 
1.0  g   environment  and  the  threshold  has  been  located  as  about 
0.01  g. 

What  is  the  subjective  perception  attributed  to  the  utri- 
cle?  Figure  4.4,  which  is  the  frequency  response  of  the  sen- 
sor, presents  it  as  a  velocity  meter  over  the  spectrum  of  fre- 
quencies corresponding  to  "normal"  head  movements.   Similarly, 
the  initial  (1  to  4  sec)  response  of  the  otoliths  stimulated 
by  a  constant  linear  acceleration  will  be  proportional  to  the 
velocity  of  the  maneuver.   The  model  also  indicates  that  the 
sensor  cannot  distinguish  between  gravity  and  other  accelera- 
tion forces.   Thus  subjective  perception  of  angle  of  elevation 
or  tilt  will  be  identical  regardless  of  the  way  it  was  induced: 

(1)  by  a  change  of  body  orientation  with  respect  to  gravity; 

(2)  by  externally  applied  accelerations.   Figure  4.1  points 
out  that  subjective  estimates  of  the  angle  of  elevation  are 
smaller  than  the  actual  elevation  above  the  horizon  (slope  of 
the  line  64°/g')  .   Since  this  is  steady  state  data,  these  read- 
ings are  probably  affected  by  habituation  and  reduced  to  about 
60  percent  of  the  initial  response.   Therefore,  for  short  ex- 
posures to  tilt  from  the  vertical  and  to  elevation  angles  above 
the  horizon,  the  "instantaneous"  slope  will  be  about  100° /g, 
well  correlated  with  the  expected  90°/g,  considering  experi- 
mental scatter.   When  time  limits  are  imposed  on  the  duration 
of  exposure  to  constant  acceleration,  the  adaptation  effect, 
F(s),  will  not  substantially  affect  the  subjective  orientation 
to  the  apparent  vertical. 


5.    THE  EYE— A  DEPENDENT  SENSOR 

The  eye  perceives  body  orientation  with  respect  to  the  en- 
vironment.  This  information  is  of  high  resolution  and  is  re- 
ferred to  objects  observed  in  the  immediate  surroundings.   In 
addition,  the  human  can  exercise  voluntary  control  of  eye  move- 
ments in  searching  for  a  reference  to  which  he  relates  his 
orientation.   These  capabilities  of  the  visual  system  render 
the  eye  as  an  orientation  sensor  of  prime  importance  to  man. 
However,  the  ocular  mechanism  is  by  itself  a  multi-input  servo 
control  system  with  inputs  fed  to  it  by  other  orientation  sen- 
sors, by  the  eye  itself,  and  by  the  voluntary  tracking  inten- 
tions of  humans.   Therefore,  the  orientation  cues  the  eye  will 
provide  depend  upon  the  visual  and  motion  conditions  in  the 
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man-environment  system,  and  the  dynamic  characteristics  of  the 
sensors  involved  in  sensing  spatial  orientation. 

Control  of  Lateral  Eye  Movements 

The  eye  movement  control  system  rotates  the  eye  in  order 
to  maintain  the  image  of  an  object  of  fixation  upon  the  retina. 
A  displacement  of  this  image  is  caused  by  the  motion  of  the 
visual  target  and  by  rotations  of  the  head  on  the  body.   The 
eye  movement  control  system  will  respond  to  these  motions  with 
two  different  modes  of  eye  movements:  tracking  and  compensa- 
tory movements.   Tracking  eye  movements  follow  the  moving 
target  in  the  visual  field.   Compensatory  eye  movements  rotate 
the  eye  in  a  direction  opposite  to  the  rotation  of  the  human 
body . 

The  eye  has  rotational  freedom  with  respect  to  the  skull 
and  the  skull  as  a  whole  may  rotate  with  respect  to  the  trunk 
with  the  neck  as  a  pivot.   Accordingly,  the  eyeball  may  be  con- 
sidered as  mounted  on  two  gimbals  with  limited  freedom  of  motion 
with  respect  to  the  trunk. 

Rotation  of  the  whole  gimbal  system  or  relative  rotation 
between  the  head  and  the  trunk  will  cause  compensatory  eye  move- 
ments.  Angular  accelerations  stimulate  the  semicircular  canals 
and  rotation  of  the  head  upon  the  trunk  excites  receptors  in 
the  neck.   Consequently  three  motion  sensors  are  involved  in 
the  eye  movement  control  system:  the  eye,  the  semicircular  canals 
and  the  receptors  in  the  neck. 

The  schematic  diagram  in  Figure  5.1  shows  the  multiinput 
feature  of  the  eye  movement  control  system.   The  semicircular 
canals  and  the  relative  rotation  sensitive,  neck  receptors  are 
the  sensors  which  provide  information  about  skull  motion  in 
space.   Since  any  rotation  of  tiie  head,  if  not  compensated  by 
an  opposite  eye  movement,  will  result  in  image  displacement  on 
the  retina,  the  motion  information  does  not  need  any  processing 
and  is  fed  directly  into  the  motor  end  of  the  eye  control  servo- 
mechanism  to  initiate  immediate  compensatory  eye  movements. 
The  tracking  movements'  branch  of  the  control  loop  responds 
to  an  error  between  the  actual  image  of  a  fixation  point  on 
the  retina  and  its  desired  location. 

The  study  of  the  eye  movement  control  system  presented  in 
this  section  investigates  the  response  of  the  system  in  the 
presence  of  relative  rotation  about  the  vertical  axis  between 
the  human  and  the  environment.   Previously,  this  control  system 
has  been  investigated  for  horizontal  eye  tracking  movements  (177) . 
Although  compensatory  eye  movements  attributed  to  the  vestibular 
system  are  reported  in  the  literature,  a  detailed  frequency  re- 
sponse measurement  of  them  has  not  been  presented  (96,  135). 

The  experimental  work  here  is  a  frequency  response  study 
of  the  eye  movement  control  system  for  horizontal  eye  move- 
ments.  By  investigating  the  separate  control  loops  (except 
for  the  visual  tracking  branch)  and  their  combination,  a  com- 
plete mathematical  model  of  the  system  is  obtained. 
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Rotation  of  the  human  body  and  head  can  be  sensed  by  the 
semicircular  canals,  the  neck  receptors,  or  both.   The  eye  move- 
ments corresponding  to  inputs  from  these  sensors  are  presented 
as  transfer  functions  from  the  input  vector  to  the  resultant 
eye  motion.   The  system  responses  were  also  investigated  when 
a  visual  fixation  was  made  to  an  object  both  in  a  rotating  and 
in  an  earth-fixed  environment. 

Compensatory  Eye  Movements — Vestibular  Stimulation 

The  existence  of  compensatory  eye  movements  accompanying 
periods  of  stimulation  of  the  vestibular  sensors  has  been  docu- 
mented extensively  (38,  77,  83,  86).   As  discussed  in  the  third 
section,  compensatory  eye  movements  are  considered  as  an  objec- 
tive measurement  of  the  dynamic  response  of  the  semicircular 
canals.   Rotations  of  the  body  around  a  vertical  earth-fixed 
axis  do  not  involve  stimulation  of  the  otoliths  which  exceeds 
the  threshold  level.   The  compensatory  eye  movements  during  such 
rotations  and  in  general  are  considered  to  be  controlled  by  the 
semicircular  canals. 

The  phenomenon  of  compensatory  eye  movements  maintained  by 
stimulation  of  the  vestibular  sensors  is  known  as  vestibular 
nystagmus.   This  motion  of  the  eye  is  characterized  by  a  slow 
rotation  opposite  to  the  direction  of  rotation  of  the  skull 
called  the  "slow  phase"  and  fast  return  in  phase  with  the  ro- 
tation, the  "fast  phase."   While  the  slow  phase  is  clearly  for 
image  stabilization  purposes,  the  sharp  flick  of  the  fast  phase 
has  been  explained  as  a  return  to  a  new  fixation  point  after  a 
limit  of  travel  off  the  center  position  of  the  eye  was  reached. 
However,  the  nearly  uniform  time  intervals  of  the  fast  phase, 
and  the  randomness  of  the  angular  rotations  prior  to  return 
suggest  control  of  the  central  nervous  system  on  it  rather  than 
caused  by  some  saturation  process  (59) . 

The    Cupular   Model.      The  frequency  response  of  the  hori- 
zontal semicircular  canals  indicates  dynamic  characteristics 
of  an  angular  velocity  meter  over  a  range  of  two  decades  of 
frequencies.   (See  Fig.  3.8.)   Thus  image  stabilization  on  the 
retina  of  the  eye  during  periods  of  head  rotations  is  possible 
by  control  of  the  eye  muscles  through  the  vestibular  system. 
Indeed,  fibers  from  the  vestibular  nuclei  of  nerves  ascend  to 
reach  the  motor  nuclei  of  the  eye  muscles  (43,  76).   Provided 
the  dynamics  of  the  motor  end  of  the  eye  are  fast  enough,  the 
response  of  the  eye  to  the  input  from  the  semicircular  canals 
will  resemble  the  response  of  the  canals  to  the  input  rota- 
tions.  In  view  of  these  considerations,  the  assumption  about 
the  velocity  of  the  slow  phase  of  the  nystagmus  being  propor- 
tional to  the  cupula  deflection  in  the  canals  credits  the  sys- 
tem design  of  nature  with  the  best  capabilities  of  image  sta- 
bilization.  According  to  this  assumption,  the  expected  fre- 
quency response  of  the  compensatory  eye  movements,  considering 
the  slow  phase  motion  only,  can  be  evaluated  as  follows: 
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e  (s)  ^  s   (21) 

Y^(s)    (s  +  oj^)  (s  +  0)^) 

where  Eq.  (21)  is  the  transfer  function  of  the  semicircular 
canals  in  response  to  an  input  angle,   ,  of  head  rotation. 
The  velocity  of  the  slow  phase  is  assumed  to  be: 

spis)    =    -A    e(s)  (22) 

with  p  as  the  cumulative  eye  position  and  the  minus  sign  in- 
dicating eye  movement  opposite  to  the  rotation  of  the  skull. 
A    is  the  sensitivity  relating  the  eye  angle,  p,  to  the  cupula 
angle,  6.   Consequently, 

p^^^   ^ sA (23) 

(s)      (s  +  Cd^)  (s  +  ^2) 

h 

The  term  cumulative  eye  position  is  used  to  describe  the 
total  compensatory  travel,  relative  to  the  skull,  of  the  eye 
from  a  center  position.   The  cumulative  eye  position  is  then 
the  sum  of  all  the  segments  of  slow  phase  motion  put  end  to 
end  by  eliminating  the  effects  of  several  fixation  points  in- 
troduced through  flicks  of  the  fast  phase. 

An  experiment  to  measure  the  transfer  function  of  the  eye 
movements  attributed  to  stimulation  of  the  semicircular  canals 
[Eq.  (23)]  was  performed  by  the  author.   The  preferred  tech- 
nique of  measurement  calls  for  recording  of  eye  movements  of 
an  open  eye.   In  addition,  experiments  testing  the  cupular 
model  for  compensatory  eye  movements  must  keep  the  subject 
mentally  alert  throughout  the  test  period  (38) . 

a.   Method:  A  moving  base  simulator  driven  sinusoidally 
about  the  earth  vertical  axis  (Ig)  was  used  as  the  moving 
platform  for  these  experimental  series.   The  subject  was 
seated  in  the  hooded  cab,  his  head  in  the  axis  of  rotation 
and  kept  in  normal  upright  position  by  a  biteboard,  affixed 
to  the  moving  cab  so  as  to  eliminate  any  neck  movements  dur- 
ing rotations.   Eye  movements  relative  to  the  skull  were 
measured  by  a  non-contact  method  based  upon  detection  of  the 
difference  in  reflected  light  from  the  sclera  and  the  iris 
on  both  sides  of  one  eye.   A  commercial  model  of  an  eye 
movements  monitor  with  a  linear  range  of  ±15°  and  a  resolu- 
tion of  0.1°,  mounted  on  glasses  worn  by  the  subject  was  used 
for  the  entire  series  of  experiments  described  in  this  chap- 
ter.  To  comply  with  requirements  of  complete  darkness  in 
the  cab  (elimination  of  visual  fixation  point) ,  the  necessary 
illumination  of  the  eye  ball  was  achieved  by  an  infrared  light. 
Recording  of  the  cab  position  and  eye  movements  were  taken 
continuously  during  the  experiments.   Three  subjects  parti- 
cipated in  the  experimental  series  discussed  in  this  section. 
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b.   Results  and  Discussion:  The  profile  of  frequencies 
and  corresponding  amplitudes  of  the  input  rotation  are  given 
in  Figure  5.2.   This  profile  in  effect  kept  the  peak  angular 
accelerations  constant  for  high  frequencies.   Figure  5.3  is 
a  recording  taken  for  /  =  0.5  cps.   The  upper  trace  is  the 
vestibular  nystagmus  measured  relative  to  the  skull,  cumula- 
tive eye  position  is  shown  in  the  middle,  and  the  lower  trace 
is  the  input  position  of  the  cab.   Note  the  clear  sinusoidal 
shape  exhibited  by  the  cumulative  eye  position.   With  suffi- 
cient care  exercised,  this  method  of  analysis  rendered  sinus- 
oidal input-output  relations  for  the  whole  spectrum  of  input 
frequencies  (0.03  cps-2.0  cps).   Therefore,  adequate  informa- 
tion on  the  transfer  function  from  input  angular  velocity  to 
the  compensatory  eye  velocity  in  terms  of  amplitude  ratio  and 
phase  angle  was  obtained.   This  data  is  summarized  in  Figure 
5.4  which  presents  the  experimental  results  along  with  a  mini- 
mum phase  transfer  function  fit  to  them.   This  relationship 
is  given  by 

eye  velocity  (s)       _        -  3.2s  ,24% 

input  angular  velocity  (s)    (8s  +  1) (0.04s  +  1) 

It  is  found  that  the  break  frequencies  of  the  cupular  model 
for  objective  measurement  are  displaced  with  respect  to  evalu- 
ation based  on  subjective  perception.   However,  the  important 
finding  is  concerned  with  the  gain  of  the  transfer  function, 
or  the  ratio  between  the  compensatory  eye  velocity  and  the 
skull  velocity.   This  factor  determines  the  extent  of  image 
stabilization  upon  the  eye  which  can  be  achieved  by  the  vesti- 
bular system,  while  angular  accelerations  are  applied  on  the 
body  as  a  whole.   In  contrast  to  a  common  presentation  which 
assumes  temporal  (between  two  consecutive  fast  phase  move- 
ments) preservation  of  a  stationary  picture  by  the  eye,  the 
compensation  measured  in  these  series  of  experiments  is  only 
fractional.   Over  a  wide  range  of  input  frequencies  (see  Fig 
5.4)  the  eye  compensatory  velocity  is  about  4  0  percent  of  the 
angular  velocity  of  the  skull  with  respect  to  the  environment. 
Two  other  publications  support  this  finding:  the  initial  eye 
velocity  responding  to  a  step  of  angular  velocity  was  found 
to  be  (I)  43  percent  of  the  stimulus  (102);  (2)  45  percent  of 
the  stimulus  (101) . 

The  significance  of  the  results  presented  here  is  far 
reaching.   Since  the  angular  velocity  of  the  skull  is  not 
completely  matched  by  the  relative  velocity  of  the  eye  with 
respect  to  the  skull,  the  image  upon  the  retina  is  not  sta- 
tionary but  moves  in  the  direction  of  rotation.   Accordingly, 
one  has  to  conclude  that  the  vestibular  system  alone,  or  more 
specifically,  the  semicircular  canals  cannot  achieve  space 
stabilization  of  the  eye  when  the  skull,  together  with  the 
body,  undergoes  passive  rotations. 
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Environmental    Fixation.    The  block  diagram  in  Figure  5.1 
shows  that  the  vestibular  branch  and  the  tracking  path  of  the 
eye  movement  control  system  are  activated  when  the  subject  is 
rotated  and  the  eye  has  a  visible  fixation  point.   If  the  fix- 
ation point  rotates  with  the  subject,  this  is  an  environmental 
fixation.   The  situation  corresponds  to  the  common  condition 
of  travel  in  a  maneuvering  vehicle  whose  interior  is  fully  il- 
luminated and  the  view  of  the  external  world  is  obscured.   The 
fixation  point  is  stationary  with  respect  to  the  traveler. 
However,  its  image  upon  the  retina  will  move  due  to  the  com- 
pensatory eye  movements  initiated  by  the  stimulated  semicircu- 
lar canals.   The  expected  eye  movements  will  exhibit  a  saw 
tooth  pattern,  where  the  eye  is  deviated  from  its  mean  posi- 
tion by  the  vestibular  branch  and  returned  to  it  by  visual 
tracking. 

Experimentally,  the  proper  environment  was  simulated  by 
illuminating  the  inside  of  the  cab  of  the  moving  base  simulator. 
Otherwise,  the  experimental  conditions  were  maintained  as  previ- 
ously, with  the  subjects  instructed  to  maintain  fixation  upon  a 
crossed  marker  mounted  in  the  cab  at  eye  level  and  four  feet 
away. 

Figure  5.5  is  a  record  taken  at  /  -   0.5  cps.   On  the  upper 
trace,  one  can  distinguish  the  nystagmic  beats  changing  from 
left  to  right  every  cycle.   Note  that  by  voluntary  fixation  the 
control  system  maintains  the  mean  eye  position  fixed  with  re- 
spect to  the  skull.   Consequently,  the  image  of  the  rotating 
environment  is  kept  approximately  stationary  on  the  retina. 
For  the  spectrum  of  frequencies  examined  in  this  series,  the 
eye  remained  within  ±0.5°  of  its  mean  position. 

Earth- fixed   Fixation    Point.    If  an  object  in  the  non- 
moving  surroundings  is  fixated  upon,  the  control  system  of 
the  eye  will  maintain  its  image  on  the  retina,  provided  the 
limits  of  angular  travel  of  the  eye  were  not  exceeded.   Phy- 
sically, the  description  applies  to  a  human  in  a  rotating 
vehicle  and  attempting  to  look  at  a  given  spot  outside  it. 
The  vestibular  compensatory  eye  movements  and  the  tracking 
path  of  the  control  system  are  in  phase  for  these  conditions. 
Therefore  they  are  combining  to  keep  the  fixation  point  image 
stationary. 

Experimentally,  by  removing  the  hood  from  the  cab  of  the 
moving  base  simulator  and  illuminating  the  surroundings,  a 
duplication  of  the  described  conditions  was  achieved.   A 
crossed  marker  was  taped  to  the  wall  of  the  room  8  ft  away 
from  the  subject  and  at  his  eye  level.   The  subject  was  in- 
structed to  maintain  fixation  upon  the  marker  throughout  the 
experiment. 

A  record  taken  at  /  =  1.0  cps  is  shown  in  Figure  5.6. 
Note  the  regularity  of  the  eye  position,  tracing  a  perfect 
sinusoid,  a  feature  observed  for  all  the  frequency  range 
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(0.03  cps  to  2.0  cps)  of  the  experiment.   The  frequency  re- 
sponse of  the  eye  movement  control  system  with  earth-fixed 
fixation  point  is  presented  in  Figure  5.7.   Perfect  compensa- 
tion of  amplitude  is  achieved  over  the  range  of  two  decades 
of  frequencies  approximately,  with  the  phase  lag,  however,  in- 
creasing rapidly  beyond  0.5  cps.   These  results  point  out  the 
capacity  of  the  control  mechanism  to  maintain  a  stationary 
reference  for  the  visual  system  in  presence  of  disturbances 
in  the  form  of  vehicle  rotations.   The  observation  holds  as 
long  as  the  limit  of  rotation  of  the  eye  has  not  been  exceeded 
during  the  rotational  maneuver. 

Compensatory  Eye  Movements — Neck  Proprioceptors 

The  role  of  neck  receptors  as  a  source  of  compensatory 
eye  movements  has  been  suggested  by  physiologists  in  early 
literature  (54).   In  the  rabbit,  eye  movements  were  recorded 
while  the  neck  was  bent,  but  the  validity  of  the  observation 
is  questionable  since  the  vestibular  system  of  the  animal  was 
also  stimulated  in  the  process.   For  man,  the  only  experiment 
intended  to  isolate  the  effect  of  neck  receptors  upon  eye 
movements  is  reported  in  the  literature  back  in  192  8.   The 
conclusion  the  author  reached  there  maintains  that  for  the 
experimental  condition  of  fixed  head  and  moving  trunk,  the 
corresponding  eye  movements  were  small  (54). 

If  compensatory  eye  movements  are  produced,  the  atlanto- 
axial joints  of  the  neck  and  the  muscles  participating  in  the 
relative  head-trunk  rotation  (see  Appendix  C)  have  to  contain 
the  nerve  endings  which  control  the  oculomotor  muscles.   Un- 
like the  nerves  of  the  vestibular  system,  no  direct  pathway 
from  the  nerves  of  the  neck  joints  and  muscles  to  the  motor 
nuclei  of  the  eye  has  been  identified  yet  (43).   Nevertheless, 
through  central  processing  or  a  feedback  path  to  the  vesti- 
bular nerves,  a  tie  pathway  of  innervation  from  the  neck 
receptors  to  the  eye  muscles  is,  in  all  probability,  estab- 
lished. 

The  experimental  setup  for  the  vestibular  stimulation 
was  rearranged  to  allow  rotation  of  the  trunk  while  the  head 
is  kept  still.   The  subject  was  seated  in  the  cab  of  the  sim- 
ulator with  the  vertical  axis  of  it  running  along  the  neck. 
His  eye  was  illuminated  with  a  stationary  infrared  light 
source.   With  the  skull  fixed  to  the  stationary  gimbal  of  the 
simulator  by  a  bite  board,  care  was  exercised  to  provide  ro- 
tation of  the  trunk  that  is  free  of  bending. 

As  seen  in  Figure  5.8,  distinct  compensatory  eye  move- 
ments are  recorded  for  sinusoidal  rotation  of  the  trunk.   The 
experimental  record  is  for  input  frequency  of  0.6  cps  and  the 
input  amplitude  is  ±13.5  degs.   The  "cumulative"  eye  position 
shows  an  angular  travel  of  the  eyeball  of  ±1.0  degs. 
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Examination  of  the  recording  emphasizes  two  characteristic 
features  of  the  eye  motion:  (1)    eye  movements  resemble  vesti- 
bular nystagmus  with  slow  and  fast  phases;  (2)  the  eyeball  is 
driven  in  phase  with  the  motion  of  the  trunk.   The  latter  ob- 
servation is  indeed  in  agreement  with  expected  compensation  for 
normal  head  on  body  rotations.   Rotation  of  the  trunk  to  the 
left  with  head  fixed  corresponds  to  rotation  of  the  head  to  the 
right,  while  the  trunk  is  stationary.   For  these  relative  angu- 
lar rotations,  the  compensatory  motion  of  the  slow  phase  should 
be  to  the  left  as  is  the  case  at  hand. 

The  frequency  response  of  the  experimental  data  from  in- 
put angular  velocity  to  compensatory  eye  velocity  is  shown  in 
Figure  5.9.   Examination  of  it  finds  the  eye  movements  recorded 
to  be  extremely  small  for  frequencies  above  2.5  rad/sec.   How- 
ever, the  amount  of  compensation  rises  approximately  to  the 
vestibular  level  (in  the  range  0.02  cps  to  4.0  cps)  at  frequen- 
cies below  0.6  rad/sec.   A  theoretical  fit  to  the  data,  in  the 
form  of  a  lag-lead  network  is  given  by: 

eye  velocity  (s)   _  .325  (1  +  0. 43g)  (25) 

input  angular  velocity      (1  +  1 . 74s) 

This  series  of  experiments  established  the  relation  of 
compensatory  eye  movements  to  stimulation  of  the  neck  proprio- 
ceptors.  Their  transfer  function,  approximated  by  Eq.  (2  5)  in- 
dicates eye  velocities  from  DC  to  about  1  rad/sec  comparable  in 
amplitude  to  the  velocities  measured  in  response  to  stimulation 
of  the  semicircular  canals  (0.02  cps  to  4  cps).   However,  the 
phase  relations  attributed  to  the  two  branches  of  the  control 
system  differ  rather  radically.   While  eye  velocity  due  to  the 
vestibular  branch  leads  the  input  velocity  for  the  spectrum  of 
frequencies  under  consideration,  the  compensatory  motion  by 
proprioception  lags  the  input  rotation. 

Environmental    and   Earth-fixed   Fixation    Points.    The  study 
of  the  simultaneous  stimulation  to  the  neck  proprioceptors  and 
the  tracking  branch  of  the  eye  movement  control  system  is  of  a 
distinct  academic  interest,  since  these  conditions  are  not  en- 
countered in  real  life.   However,  the  experimental  evaluation 
of  eye  movements  in  the  presence  of  an  environmental  or  earth- 
fixed  fixation  point  can  provide  data  for  further  validation 
of  the  model  of  the  control  system.   Experimentally,  the  en- 
vironmental fixation  is  achieved  by  illuminating  the  interior 
of  the  rotating  cab  of  the  simulator,  while  still  maintaining 
the  head  fixed  to  the  stationary  gimbal  of  it.   The  response 
of  the  control  system  calls  for  sinusoidal  eye  movements,  with 
the  main  contribution  being  that  of  visual  tracking.   Since 
proprioceptive  drive  of  the  eye  is  negligible  for  frequencies 
above  4.0  cps,  the  regularity  in  tracking  movements  should 
deteriorate  with  increase  in  frequency  in  a  manner  similar 
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to  the  movements  recorded  for  tracking  only  (177) .   The  record 
shown  in  Figure  5.10  is  for  eye  movements  with  environmental 
fixation  at  /  =  0 . 8  cps.   When  the  input  frequency  is  raised 
further,  the  Fourier  series  of  the  response  contain  sizable 
terms  besides  the  fundamental. 

With  earth-fixed  fixation  point  during  stimulation  of  the 
neck  receptors,  the  eye  is  driven  to  maintain  its  mean  position 
constant  relative  to  the  skull.   Therefore,  at  low  frequencies, 
the  visual  tracking  loop  should  correct  for  compensatory  move- 
ments driven  by  the  proprioceptors,  and  at  high  frequencies 
the  tracking  loop  prevents  eye  drift.   Examination  of  Figure 
5.11,  which  presents  movements  with  earth-fixed  fixation  point 
at  /  =  0.2  cps,  supports  this  notion  of  response  of  the  eye 
movement  control  system.   The  total  travel  of  the  eye  from  its 
center  position  is  ±0.5  degs,  while  the  "cumulative"  eye  posi- 
tion for  the  same  conditions  without  a  fixation  should  have 
been  ±2.0  degs. 

Compensatory  Eye  Movements — Vestibular  and 
Neck  Proprioceptors  Stimulation 

Frequent  movements  of  the  human  involve  rotation  of  the 
head  while  the  eye  is  fixated  upon  a  given  object  in  the  visu- 
al field.   During  these  rotating  motions,  the  vestibular  system 
and  the  neck  proprioceptors  are  stimulated.   Therefore,  the 
accompanying  eye  movements  are  due  to  all  three  of  the  motion 
sensors,  the  eye,  the  semicircular  canals  and  the  neck  proprio- 
ceptors.  The  compensation  achieved  for  these  circumstances  is 
a  measure  of  the  maximum  capability  of  the  eye  movement  control 
system  to  preserve  a  stationary  reference  on  the  eye. 

One  should  raise  the  question  whether  the  control  system 
is  linear  over  the  spectrum  of  frequencies  measured  in  these 
series  of  experiments.   If  affirmative,  the  compensatory  eye 
movements  for  combined  stimulation  of  the  three  motion  sensors 
will  be  the  vectorial  sum  of  the  individual  contributions  by 
the  semicircular  canals,  the  neck  proprioceptors,  and  visual 
tracking.   The  importance  of  the  concept  of  linearity  of  the 
control  system  is  far  reaching.   By  virtue  of  it,  compensatory 
eye  movements  are  predictable  just  on  the  basis  of  the  data  on 
the  environmental  conditions  and  a  mathematical  model  of  the 
control  system.   Evidently,  the  crucial  experiment  testing  the 
linearity  of  the  system  is  for  combined  stimulation  of  the 
semicircular  canals  and  the  neck  proprioceptors  in  the  absence 
of  visual  fixation. 

a.   Method:  The  subject  was  accommodated  in  a  chair  with 
his  back  supported  in  upright  position.   His  head  was  fitted 
with  an  adjustable  head  band  which  carried  a  small  infrared 
light.   A  potentiometer  with  its  case  stationary  and  its  slider 
in  the  head  band  was  used  to  measure  head  position.   The  ex- 
perimenter, by  counting  throughout  the  experiment,  provided  the 
beat  according  to  which  the  subject  rotated  his  head,  simulating 
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sinusoidal  rotation.   The  experimental  series  was  carried 
through  in  a  dark  room. 

b.   Results  and  Discussion.  The  recorded  data  was  ana- 
lyzed by  reconstructing  the  cumulative  eye  position  relative 
to  the  head  and  measuring  the  respective  amplitude  ratio  and 
phase  lag  at  any  given  frequency.   A  Bode  plot  of  the  results 
with  one  standard  deviation  around  the  mean  is  presented  in 
Figure  5.12.   The  sum  of  the  eye-semicircular  canals  transfer 
function  [Eq.  (24)]  and  the  eye-neck  proprioceptors  transfer 
function  [Eq.  (25)]  is  also  shown  in  Figure  5.12  represented 
by  its  straight  line  approximation.   The  sum  of  Eq.  (2  4)  and 
Eq.  (25)  is  given  by: 


eye  velocity  (s) 


input  angular  velocity  (s) 


(26) 

-0.32  5  (19.2s  +l)(1.12s+l)(0. 0067s  +  1) 
(8s  +  1)  (1.74s  +  1)  (0.04s  +  1) 


Examination  of  Figure  5.12  shows  complete  agreement  be- 
tween the  experimental  data  and  the  predicted  response  from 
the  separate  transfer  functions  for  the  vestibular  system 
and  the  neck  proprioceptors.   Therefore,  the  eye  movement 
control  system  is  a  linear  system  at  least  over  the  range 
of  frequencies  tested  here  (0.03  cps  to  2.0  cps) .   Since  the 
amplitude  ratio  is  between  0.35  and  0.55  for  the  frequency 
range  from  0.02  cps  to  2  cps,  the  compensation  is  only  par- 
tial and  the  preservation  of  a  stationary  image  on  the  retina 
without  the  participation  of  visual  tracking  is  impossible. 
The  relative  contribution  of  the  vestibular  system  in  the  re- 
sultant compensatory  eye  movement  is  larger  compared  to  that 
of  the  neck  proprioceptors  at  frequencies  above  0.2  cps  while 
below  it,  the  effect  of  both  systems  is  approximately  equal. 

Environmental    and   Earth- fixed    Fixation    Points.    Rotations 
of  the  skull  in  the  presence  of  a  fixation  point  is  the  most 
common  pattern  of  maneuvers,  during  which  the  eye  movement 
control  system  is  called  upon  to  stabilize  the  eyeball  on  a 
given  object.   For  such  rotations,  all  the  loops  of  the  con- 
trol system  are  activated,  thus  the  response  of  the  system  is 
the  ultimate  of  stabilization  the  eye  can  achieve. 

Experiments  done  here  show  the  total  travel  of  the  eye 
in  the  presence  of  an  environmental  fixation  point  to  be  at 
the  maximum  of  ±0.5  degs.   And  for  earth-fixed  fixation,  the 
frequency  response  of  the  control  system  shown  in  Figure  5.13 
exhibits  good  compensation  capabilities  over  the  whole  spec- 
trum of  frequencies  up  to  2.0  cps.   The  phase  angle  for  visual 
tracking  of  predictable  sinusoids  (177)  is  also  shown  on  Fig- 
ure 5.13.   Note  the  distinct  contribution  of  the  vestibular 
system  and  the  neck  proprioceptors  in  reducing  the  phase  lag 
of  the  eye  at  high  frequencies. 
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stabilization  of  Eye  Position  in  Space 

The  eye  movement  control  system  as  presented  in  the  block 
diagram  of  Figure  5.1  consists  of  three  branches,  each  of  which 
contributes  to  the  control  of  the  eyeball  position  relative  to 
the  skull  and  the  environment.   The  compensatory  eye  movements 
attributed  to  the  vestibular  system  and  the  neck  proprioceptors 
are  of  the  nature  of  reflex  responses  with  no  voluntary  control 
upon  them.   Tracking  movements,  on  the  other  hand,  depend  upon 
the  wish  to  maintain  a  certain  object,  in  the  immediate  vicinity, 
under  observation.   Regardless  of  their  origin,  eye  movements 
during  periods  of  motion  disturbances  are  controlled  to  keep 
the  eye  position  stationary  with  respect  to  an  environment  which 
is  judged  as  stationary  too. 

Table  5.1  summarizes  qualitatively  the  experimental  results 
obtained  in  the  series  of  experiments  performed  here.   In  the 
presence  of  fixation  points,  rotation  of  the  skull  with  respect 
to  the  body  or  rotations  of  the  body  as  a  whole,  tend  to  dis- 
place the  stationary  picture  observed  by  the  eye.   The  experi- 
ments show  that  the  eye  is  stabilized  in  space  within  ±0.5  degs 
when  the  fixation  is  on  the  moving  surrounding.   And  for  an 
earth-fixed  fixation  point,  the  eye  compensates  with  essentially 
a  constant  amplitude  ratio  and  minimal  phase  lag  in  response  to 
input  frequencies  of  rotations  up  to  2  cps.   Figure  5.14  is  the 
mathematical  model  for  the  horizontal  eye  movement  control  mech- 
anism.  It  incorporates  the  visual  tracking  model  proposed  by 
Young  (177) ,  and  the  dynamic  characteristics  of  the  semicircu- 
lar canals  and  the  neck  proprioceptors,  when  related  to  compen- 
satory eye  movements  as  measured  here.   The  linearity  of  the 
summing  point  prior  to  the  motor  mechanism  of  the  eyeball  was 
established  experimentally  for  addition  of  vestibular  and  pro- 
prioceptor signals.   Therefore,  the  assumption  of  additive 
property  for  the  visual  tracking  branch  too  is  plausible  and 
experiments  show  quantitatively  such  behavior. 

The  eye  movement  model  was  simulated  on  an  EAI  TR4  8  com- 
puter and  the  response  of  the  simulated  system  was  compared 
with  the  experimental  results.   The  model  reproduced  very  well 
the  measured  eye  movements  in  the  presence  of  visual  fixation. 
Without  this  fixation,  the  "cumulative"  eye  position  only  ("fast" 
phase  was  not  simulated)  was  obtained. 

The  performance  capabilities  of  the  eye  as  an  orientation 
sensor  can  be  derived  from  the  model  presented  here  for  any 
maneuver  involving  rotation  around  a  vertical  axis.   Comparison 
of  eye  movements  with  an  earth  fixation  point,  with  and  with- 
out the  participation  of  the  vestibular  system,  in  the  control 
loop  outlines  the  contribution  of  this  system  toward  stabiliza- 
tion of  the  eye.   With  the  vestibular  system  stimulated,  eye 
movements  are  smooth  and  regular,  free  of  harmonics.   When  the 
vestibular  system  is  unstimulated,  eye  movements'  wave  shape 
loses  similarity  to  the  input  sinusoid  for  frequencies  above 
0.8  cps.   The  visual  tracking  loop  alone,  which  is  a  position 
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control  system,  shows  similar  distortion  of  the  wave  shape  of 
eye  movements  for  high  input  frequencies  (177).   However,  with 
the  vestibular  system  stimulated  and  with  visual  fixation,  the 
wave  shape  regularity  of  eye  movements  is  preserved  for  input 
frequencies  close  to  2 . 5  cps.   In  view  of  these  findings  and 
considering  the  semicircular  canals  as  angular  velocity  meters, 
one  can  conclude  that  the  vestibular  system  provides  the  rate 
information  for  the  eye  movement  control  system,  while  the 
visual  tracking  monitors  mainly  the  deviation  of  the  eye  from 
a  given  fixation  point. 

Table  5 . 1 
Space  Stabilization  of  Eye 


Environment  at 
No    Fixation    Point  Fixation 


Earth- fixed 
Fixation 


Vestibular 


Partial  compensa-  Maintain  eye 
tion  of  rotational  angle  within 
rate  over  frequen-  ±0.5°  up  to 
cies  from  0.02  cps  2  cps 
to  4.0  cps 


Full  compen- 
sation up  to 
2  cps 


Neck  pro- 
priocep- 
tors 


Partial  compensa- 
tion of  rota- 
tional rate  below 
0.15  cps 


Poor  compensa- 
tion above 
1  cps 


Maintain  eye 
angle  within 
±0.5°  up  to 
2  cps 


Vestibular 
and  neck 
proprio- 
ceptors 


Partial  compensa-  Maintain  eye 

tion  of  rotational  angle  within 

rate  up  to  4 . 0  ±0.5°  up  to 

cps  2  cps 


Full  compen- 
sation up  to 
2  cps 
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6.  SIMPLE  MANUAL  CONTROL  SYSTEMS  WITH  MOTION  INPUTS 

A  manual  control  system  is  a  closed  loop  system  in  which 
the  human  operator  attempts  to  reduce  the  system  error.   In 
a  single  axis,  compensatory  tracking  loop,  the  operator  per- 
ceives the  system  error  only  and  affects  the  system  output  by 
manipulating  a  control  stick  (Fig.  6.1).   The  mathematical  rep- 
resentation of  the  operator's  response  for  a  given  task  is  gen- 
erally assumed  to  fit  a  quasi-linear  description  (129,  50). 
Thus,  the  model  of  the  human  operator  contains  a  "describing 
function"  linearly  correlated  with  the  system  error,  and  an 
additive  remnant  uncorrelated  with  it.   The  ability  of  the  hu- 
man operator  to  adapt  his  response  to  the  system  inputs  and  to 
the  controlled  elements  provides  the  manual  control  systems 
with  a  desirable  flexibility.   However,  this  feature  also  pre- 
vents a  unique  presentation  of  the  transfer  characteristic  of 
the  operator  since  his  dynamic  response  is  a  function  of  the 
control  system  parameters.   Nevertheless,  a  tabulation  of  de- 
scribing functions  for  various  system  conditions,  is  of  great 
importance  to  the  preliminary  design  of  manual  control  systems. 

The  Vestibular  System  As  an  Input  Channel 
in  Manual  Control  System 

The  human  operator  in  a  vehicle  orientation  control  loop 
receives  the  necessary  information  for  his  control  decisions 
through  a  visual  display,  by  motion  sensing,  or  by  means  of 
audio  communication.   Describing  functions  have  been  obtained 
by  others  for  manual  control  systems  in  a  single  axis  compensa- 
tory task  with  visual  input  and  manual  output  covering  a  wide 
class  of  controlled  elements  (129). 

In  a  vehicle  control  loop,  the  operator  always  receives 
motion  inputs  when  seated  in  the  vehicle.   The  effect  of  these 
motion  cues  on  the  operator's  characteristics  is,  in  general, 
acknowledged  (150,  53).   However,  their  contribution  to  the _ 
operator's  ability  to  generate  lead  compensation  and  to  satis- 
factorily control  a  closed  loop  system  have  not  been  assessed 
prior  to  this  investigation. 

Consider  the  restricted  case  of  control  of  vehicle  orienta- 
tion to  a  stationary  reference  frame.   Nonvisual  perception  of 
motion  in  the  human  is  provided  by  the  vestibular  sensors, 
supplemented  by  tactile  and  kinesthetic  sensations.   The  vesti- 
bular sensors  perceive  the  resultant  angular  accelerations  and 
specific  forces  acting  on  the  man  in  the  vehicle.   The  motion 
inputs  the  operator  senses  are,  therefore,  compatible  with  the 
definitions  of  a  compensatory  tracking  task  for  a  stationary 
reference. 

Vehicle  motions  combine  rotations  and  translations  stimu- 
lating both  the  semicircular  canals  and  the  otoliths.   However, 
an  experimental  situation  can  be  simulated  where  motions  are 
classified  according  to  three  categories:  (I)  pure  rotational 
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motion  in  the  horizontal  plane;  (2)    pure  translation;  and 
(3)  rotational  motion  with  respect  to  the  gravity  vector. 
Under  these  simulated  conditions,  angular,  linear,  or  com- 
bined accelerations  are  perceived  by  the  human.   They  provide 
the  desired  separation  between  the  orientation  information  of 
the  semicircular  canals  and  the  otoliths. 

In  a  typical  manual  control  system,  the  human  operator 
will  attempt  to  maintain  some  reference  orientation  in  the 
presence  of  a  disturbance.   The  block  diagram  in  Figure  6.2 
represents  the  manual  control  system  simulated  for  this  study 
of  the  vestibular  system  in  simple,  compensatory  tasks.   The 
dynamics  of  the  vehicle  in  the  system  were  a  single  integra- 
tion, presumably  the  optimum  one  for  the  operator  to  control. 
In  this  system,  operator  stick  displacement  is  proportional 
to  vehicle  velocity.   The  human  operator  may  have  three  modes: 
visual,  motion,  or  combined.   He  attempts  to  control  his  ve- 
hicle to  a  preset  reference  in  the  presence  of  orientation 
disturbances . 

The  characteristics  of  the  human  operator  in  these  manual 
control  systems  were  analyzed  in  terms  of  quasilinear  describ- 
ing functions.   The  identification  technique  outlined  in  Ap- 
pendix D  defines  the  transfer  function  of  the  human  operator 
as : 

$  .    (lo) 

where  0  .   (to)  =  cross  power  spectral  density  of  input  and 

operator's  output  and 

$  .   (w)  =  cross  power  spectral  density  of  input  and 
system  error. 

For  the  experimental  manual  control  system,  the  input  is 
the  noise  disturbance,  and  the  system  error  is  the  deviation 
of  the  vehicle  orientation  from  the  reference.   A  measure  of 
the  similarity  of  the  human  operator's  transfer  characteristics 
to  a  linear  element  is  provided  by  the  square  of  the  linear 
correlation,  P   ,  given  by: 

2 

n  1  '^  •   I  ^ 

^^  aa  oc 

where  0   (co)  =  the  remnant  power  spectral  density, 

$  .  .  (co)  =  the  input  (disturbance)  power  spectral  density, 
and 

$   (w)  =  the  human  operator's  response  power  spectral 
density. 
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2 

A  value  off      near  unity  implies  that  the  operator's  rem- 
nant IS  small  compared  with  his  output,  which  is  correlated 
with  the  system  input.   In  a  manual  control  system  with  a  sto- 
chastic disturbance,  to  avoid  prediction,  the  measured  oper- 
ator's characteristics  are  closely  approximated  by  the  calcu- 
lated transfer  functions. 

The  disturbance  input  in  this  experimental  series  was  fil- 
tered Gausian  noise,  generated  by  a  noise  generator,  with  a 
constant  power  spectral  density  from  DC  to  50  cps.   This  noise 
was  shaped  with  two  cascaded  first  order  filters,  with  corner 
frequencies  at  0.15  cps,  while  its  rms  amplitude  was  adjusted 
for  each  experimental  condition. 

A  Manual  Control  System  with  Pure  Horizontal  Rotation 

Rotation  of  a  vehicle  about  the  gravity  vector  (yaw)  is 
a  control  situation  where  the  otoliths  can  be  maintained  un- 
stimulated by  linear  accelerations,  except  for  the  ever  present 
gravity  field.   If  the  head  of  the  subject  is  placed  in  the 
axis  of  rotation  of  the  simulator,  and  maintained  fixed  with 
respect  to  the  moving  cab,  the  centrifugal  and  the  tangential 
accelerations  arising  from  the  rotational  motion  can  be  mini- 
mized. 

The  block  diagram  of  Figure  6.2  points  to  three  modes  for 
the  human  operator,  all  of  which  were  investigated  here: 
(2)    visual  display  with  no  motion,  corresponding  to  a  fixed 
base  control  system;  (2)  vestibular  information  with  no  visual 
display;  and  (3)    combined  visual  display  and  vestibular  sensa- 
tion of  motion. 

a.   Method:  Manual  control  of  attitude  was  performed  driv- 
ing a  moving  base  simulator  about  its  vertical  axis.   In  the 
rotating  cab  of  the  simulator,  an  oscilloscope  displaying  a 
vertical  line  provided  the  visual,  compensatory  input.   The 
operator,  strapped  to  his  chair,  had  his  head  supported  with 
a  headrest.   He  exercised  control  on  the  system  with  a  light- 
weight, spring  restrained,  linear  stick,  mounted  beside  his 
seat  for  right  hand  manipulation.   The  experimental  parameters 


were 


white  noise  disturbance — 15°  rms 

visual  display — 2/15  inch/degree  of  rotation 

control  gain — K   =0.5  deg/sec/degree  of  stick 

stick — linear,  with  maximum  travel  of  ±45°,  corresponding 
to  velocity  command  of  ±22.5  deg/sec. 

In  visual  and  combined  modes  the  operator  was  instructed 
to  maintain  his  initial  orientation.   Two  different  operator 
tasks  were  experimented  with,  for  motion  tracking  only:  (1)    to 
keep  the  vehicle  on  course;  and  (2)  to  keep  the  vehicle 
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stationary.   The  difference  between  these  instructions  is 
whether  or  not  a  correction  for  accumulated  drift,  off  course, 
should  be  introduced  by  the  operator. 

Three  subjects  were  used  for  this  experimental  series. 
They  had  previous  experience  in  operating  manual  control  sys- 
tems and  were  trained  for  the  experimental  tasks.   Each  subject 
was  scored  on  10  runs  of  90  seconds  duration  for  each  experi- 
mental condition. 

b.   Results:  For  each  run  of  the  visual  and  visual-motion 
tracking,  the  noise  disturbance,  system  error,  operator's  out- 
put, and  integrated  stick  output  were  recorded  on  magnetic 
tape,  converted  to  digital  form,  and  processed  by  an  IBM  7094 
digital  computer.   The  describing  functions  for  the  human  op- 
erator were  determined  by  the  identification  procedure  out- 
lined in  Appendix  D.   These  results  were  averaged  for  each 
subject  yielding  the  mean  amplitude  ratio  and  the  phase  angle 
versus  frequency.   Standard  deviation  of  these  were  also  eval- 
uated.  The  correlation  coefficient  at  any  given  frequency 
was  determined.   Results  with/"  ^  <  o.7  5  were  dropped  because 
the  assumption  of  quasilinearity  becomes  poor.   This  procedure 
provided  experimental  describing  functions  in  terms  of  ampli- 
tude ratio  and  phase  angle  over  the  frequencies  from  0.05  6  cps 
to  0.8  cps  for  each  subject. 

The  describing  functions  were  tested  for  intersubject 
differences  which  were  not  found  to  be  significant  (P  >  0.100). 
Following  this  observation,  a  theoretical  fit  to  the  averaged 
experimental  data  was  obtained  with  the  results  summarized 
below: 


7e"°-^®(2  4s  +  1)   ^   ^^^ 
visual  input  Y^{s)    =         (3,15.  +1)     ' =  0.075    (29) 


e^     (t) 


-0 .  Is 

visual  and    Y    (s)    =    '^^  i-.'.J'^'J't^^   ^^  ' =  0.050 

motion      P      ^       -2- 


(30) 


input 


i       it) 


The  describing  function  obtained  for  visual  input  is  in 
good  agreement  with  results  published  previously  (89,  148). 
At  frequencies  up  to  0.2  cps,  the  data  agree  with  that  of  Rus- 
sell (148).   For  larger  frequencies,  the  operator's  phase  lag 
follows  closely  the  results  of  Hall  (89)  .   Note  that  Hall  used 
input  noise  comparable  to  the  disturbance  input  here. 

The  experimental  compensatory  task,  with  motion  sensing 
only,  did  not  yield  any  meaningful  results  in  terms  of  describ- 
ing functions  for  the  human  operator.   Subjects  were  unable  to 
keep  the  simulator  within  its  travel  limits  (about  ±35°)  for 
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periods  longer  than  25  to  30  sees.   During  this  time,  the  devia- 
tion of  the  cab  off  course  increased  at  a  steady  rate  between  1 
and  3  deg/sec ,  with  superimposed  oscillations  representing  the 
control  activity  of  the  operator  in  response  to  the  input  dis- 
turbance . 

c.   Discussion:  The  experimental  describing  functions  and 
their  corresponding  analytical  approximations  point  out  the  sig- 
nificant contribution  of  motion  cues  to  satisfactory  performance 
in  a  manual  control  system.   A  considerable  reduction  of  oper- 
ator phase  lag  is  noticed  for  the  moving  base  sijnulation  rela- 
tive to  the  fixed  base  one  (Fig.  6.3).   In  the  analytic  transfer 
function  this  reduction  is  expressed  as  a  decrease  in  dead  time 
delay  from  0.2  sec  to  0.1  sec.   The  describing  functions  are 
otherwise  equal.   The  conclusion  is  that  the  operator  is  able 
to  reduce  his  delay  time  in  a  manual  control  system  where  his 
semicircular  canals  provide  information  on  the  vehicle  motion, 
compared  to  the  delay  in  a  system  with  visual  display  only. 

Since  the  semicircular  canals  are  angular  accelerometers , 
they  cannot  detect  a  constant  angular  velocity.   This  was  demon- 
strated experimentally  in  the  motion  compensatory  task  where 
the  simulator  drifted  away  from  the  reference  with  approximately 
constant  angular  velocity.   Therefore,  complete  control  of  ve- 
hicle attitude,  including  low  frequency  drift,  is  impossible  by 
only  vestibular  sensing  of  motion.   However,  when  a  visual  ref- 
erence is  provided,  the  information  originating  in  the  semicir- 
cular canals  is  utilized  by  the  human  operator.   It  was  previ- 
ously shown  that  over  the  frequency  range  from  0.1  rad/sec  to 
10  rad/sec  that  the  canals  are  essentially  angular  velocity  me- 
ters.  Thus,  they  are  a  source  of  rate  information  for  the  op- 
erator, which  he  apparently  uses  to  generate  lead  compensation. 

Manual  Control  System  with  Linear  Motion 

In  the  last  section,  the  observation  was  made  that  the 
semicircular  canals  alone  cannot  be  used  as  sensors  in  a  manual 
control  system.   A  similar  statement  is  true  for  the  otoliths, 
the  human  specific  force  sensors.   The  difficulty  arises  from 
the  fact  that  the  compensatory  task  assigned  to  the  operator  in 
pure  linear  or  rotational  motion  does  not  fit  the  sensing  ca- 
pabilities of  the  vestibular  sensors.   The  otoliths  are  insen- 
sitive to  constant  linear  velocity.   Consequently,  a  vehicle  can 
drift  away  with  constant  linear  velocity,  and  the  operator  is 
unable  to  perceive  this  motion. 

Experimentally,  the  operator  was  given  velocity  control  on 
a  linear  motion  simulator  (see  Appendix  B) .  The  control  system 
was  as  shown  in  Figure  6.2  with  input  noise  disturbance  of  10  ft, 
rms,  and  K  =  1.0  ft/sec/deg  of  stick.  With  motion  inputs  only, 
the  operator  could  not  maintain  the  simulator  within  its  travel 
limits  for  more  than  40  sec. 
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Figure    6.3.       Desarihing    Function    of   the    Human    Operator 
in    Visual    and   Combined   Mode.       Horizontal    Rotation. 
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Control    of  Motion    with   Respect    to    the    Gravity    Vector 

The  control  of  vehicle  motion  in  roll  stimulates  both  the 
semicircular  canals  and  the  otoliths.   In  this  single  axis  task, 
the  vehicle  motion  provides  sufficient  input  information  for 
control  by  the  human  operator.   The  otoliths  are  sensitive  to 
any  angular  deviations  from  the  vertical  gravity  vector,  and  the 
semicircular  canals  sense  angular  rates.   The  manual  control  sys- 
tem permits  comparison  of  the  effects  of  various  combinations 
of  inputs  on  the  operator's  performance. 

a.   Method;  A  single  axis  compensatory  task  was  simulated 
on  the  moving  base  simulator  driven  about  its  roll  axis.   The 
visual  input  was  an  oscilloscope,  displaying  a  line  whose  angle 
with  the  vertical  corresponded  to  the  roll  angle  of  the  simu- 
lator.  The  operator  was  seated  in  the  simulator  as  described 
before. 

The  experimental  parameters  were 

white  noise  disturbance — 20°  rms 

visual  display — angle  of  display  corresponds  to  error  angle 

control  gain — K   =1.0  deb/sec/degree  of  stick 

stick — linear  with  maximum  travel  of  ±45°  corresponding  to 
velocity  command  of  ±45  deg/sec 

dead  time  delay  of  visual  display — 1  sec 

The  operator  was  instructed  to  maintain  the  simulator  ver- 
tical throughout  the  experimental  series.   His  performance  was 
measured  in  the  following  control  situations: 

(J)  Rotation  with  respect  to  gravity--motion  input  with 
hard  seat 

(2)  Rotation  with  respect  to  gravity — motion  input  with 
soft  seat 

(5)  Rotation  with  respect  to  gravity — motion  input  and 
visual  indicator 

{4)    Rotation  with  respect  to  gravity — motion  input  and 
delayed  visual  indicator 

In  comparing  two  control  situations  differing  only  in  the 
seat  on  which  the  operator  sat,  an  attempt  was  made  to  indicate 
the  effect  of  tactile  sensation  on  the  operator's  performance. 
Similarly  the  study  of  the  control  loop  with  visual  indicator, 
in  phase  with  the  motion  and  delayed,  was  intended  to  separate 
the  effect  of  the  visual  input  from  the  contribution  of  the  mo- 
tion cues. 

b.   Results:  The  describing  functions  of  the  human  operator 
in  these  control  situations  were  measured  and  analyzed  as  de- 
scribed previously.   These  results  are  summarized  below: 
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motion  input  and  hard  seat   J  (s)  =  5  =  0.045 

,P         "2 

i     it) 


e^it) 


motion  input  and  soft  seat  Y    (s)  =5  =  0.046 

i     it) 


e^it) 


motion  and  visual  inputs     I    (s)  =  5  =  0.044 

P  ~2 

i  (t) 

In  the  control  system  with  motion  input  and  delayed  visu- 
al indicator,  the  visual  information  was  delayed  with  a  dead 
time  delay  of  one  second.   All  the  three  subjects  reported  that 
they  discarded  this  information  since  it  impaired  their  perform- 
ance.  The  describing  function  of  the  human  operator  for  this 
condition,  as  well  as  others,  was  similar  to  this  measured  for 
motion  input  with  hard  seat.   Note  the  extent  of  compensation 
the  operator  achieves  in  this  control  system.   His  transfer 
function  is  a  pure  gain,  indicating  a  capability  to  compensate 
his  phase  lag  for  frequencies  up  to  0.8  cps. 

c.   Discussion ;  As  described  before,  motion  information, 
in  absence  of  visual  input,  is  perceived  by  the  vestibular  sen- 
sors and  the  tactile  receptors.   Here,  in  an  attempt  to  demon- 
strate the  effect  of  the  tactile  sensation  on  the  operator  re- 
sponse, his  performance  was  measured  in  two  control  tasks  dif- 
fering only  in  the  seat  on  which  the  operator  sat.   In  one  case, 
it  was  a  very  hard  plastic  seat,  in  the  other  an  extremely  soft, 
foam  rubber  cushion.   The  hardness  of  the  seat  was  believed  to 
vary  the  extent  of  the  perceived  tactile  sensation.   The  meas- 
ured describing  functions  do  not  indicate  any  variation  of  per- 
formance between  the  two  control  situations.   Similarly,  the 
variation  of  the  ratio  of  mean  square  error  to  mean  square  in- 
put is  not  significant  statistically.   The  conclusion  is  that 
for  this  experimental  situation,  the  tactile  sensation  does  not 
have  noticeable  influence  on  the  operator's  ability  to  perform 
his  task. 

A  comparison  of  the  operator's  characteristics  in  a  system 
with  visual  and  motion  inputs,  to  those  with  no  visual  input, 
does  not  show  a  significant  influence  of  the  visual  input. 
Similarly,  the  fact  that  the  operator  was  able  to  distinguish 
discrepancies  between  his  motion  inputs  and  the  visual  display, 
indicates  probably  that  he  monitors  the  display,  rather  than 
using  it  as  an  input. 
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The  experimental  results  presented  here  demonstrate  the 
dominant  role  of  the  vestibular  sensor  in  the  performance  of 
the  operator.   In  the  simulated,  manual  control  system,  with- 
out specific  instructions  to  the  subjects,  the  visual  input 
is  either  disregarded,  or  used  as  a  secondary  source  of  in- 
formation with  small  influence  on  the  control  decisions  of  the 
operator.   Note  that  the  describing  function  of  the  operator 
in  this  control  system  simulated  on  a  fixed  base  with  visual 
input  would  have  been  approximately 


Y      = 
P 


3.5e"°-^^(2.4s  +  1) 
(3.15s  +  1) 


based  on  the  measurements  described  previously. 

The  performance  of  the  human  operator  in  this  vehicle 
control  system  is  approximately  a  pure  gain.  (See  Figure  6.4.) 
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Figure    6.4.       Describing    Function    of   the    Human    Operator    in   Motion 
Mode.       Rotation    with   Respect    to    the    Gravity    Vector 
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This  approximation  indicates  that  the  hioman  operator  is  able 
to  compensate  for  his  dead  time  delay  and  other  lags  by  vir- 
tue of  sensing  motion  away  from  vertical.   The  motion  inputs 
substantially  improve  the  performance  of  the  human  operator 
compared  to  his  characteristics  obtained  in  a  fixed  base  simu- 
lation. 

Summary 

The  characteristics  of  the  human  operator  were  measured 
in  a  simple  manual  control  of  vehicle  orientation.   It  was 
verified  that  the  operator  cannot  use  motion  inputs  alone  for 
satisfactory  control  when  his  sensors  do  not  receive  a  con- 
stant reference  stimulus.   The  vertical  is  the  only  reference 
with  respect  to  which  the  human  can  establish  his  orientation, 
Therefore,  the  conclusion  follows  that  control  of  vehicle  ori- 
entation to  the  vertical  is  the  only  orientation  task  the  hu- 
man can  perform  with  the  vestibular  system  as  sole  input  sen- 
sor.  The  presence  of  motion  cues  in  a  simple  compensatory 
control  task  provides  the  operator  with  information  which 
greatly  improves  his  control  characteristics. 


7.  VISUAL  AND  VESTIBULAR  CONTROL  OF  AN  UNSTABLE  SYSTEM 

In  section  6,  simple  manual  control  systems  were  investi- 
gated and  "describing  functions"  for  the  human  operator  were 
presented.   There,  a  substantial  difference  in  performance  of 
the  operator  was  found  when  systems  with  visual  input  only 
were  compared  with  systems  with  motion  inputs  or  visual  and 
motion  inputs.   For  identical  system  parameters,  the  describ- 
ing function  of  the  operator  measured  with  motion  inputs  ex- 
hibits large  reduction  of  phase  lag  relative  to  the  character- 
istics obtained  with  a  fixed  base  simulation.   This  observa- 
tion, which  is  an  indication  of  the  compensation  capabilities 
of  the  human,  was  attributed  mainly  to  the  rate  information 
the  operator  receives  from  his  vestibular  sensors.   The  re- 
sults, although  convincing,  did  not  establish  quantitative  com- 
parison of  the  lead  compensation  abilities  of  the  operator  re- 
lated to  the  nature  of  inputs  he  perceives. 

By  experimenting  with  control  situations  involving  un- 
stable systems,  in  which  the  operator  had  visual  or  motion 
inputs  or  both,  it  was  hoped  to  isolate  and  identify  his  com- 
pensation characteristics. 

Control  of  an  Unstable  System 

Method.      The  control  of  the  deviation  from  the  vertical 
of  a  moving  base  flight  simulator  (see  Appendix  A)  driven  about 
its  roll  axis,  simulated  a  single-axis  compensatory  tracking 
task  for  the  human  operator. 
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Three  control  situations,  (i)  visual,  (2)    motion,  or 
(3)  combined  visual  and  motion,  were  studied  for  identical 
external  loop  characteristics  as  illustrated  in  Figure  7.1. 
For  the  visual  experiments  the  subject  was  outside  the  sim- 
ulator, seated  10  ft  away  from  it.   A  reference  marker, 
mounted  horizontally  on  the  moving  cab,  aided  the  operator 
in  judging  any  tilt  of  it  with  respect  to  the  laboratory  back- 
ground.  For  the  motion  experiments,  the  operator  was  forced 
to  utilize  the  sensing  capabilities  of  the  vestibular  system 
and  the  pressure  sensing  tactile  sensors  to  control  orienta- 
tion to  the  vertical.   The  subject  was  seated  in  the  moving 
cab,  strapped  to  his  chair,  with  head  supported  and  fixed  in 
order  to  control  inputs  to  the  vestibular  mechanism.   The  sim- 
ulator cab  was  covered  with  a  lightproof  hood,  no  instruments 
were  used  inside  the  cab  and  the  interior  was  not  lighted. 
The  subject  was  seated  and  supported  in  a  similar  manner  for 
the  combined  visual  and  motion  cues  study  except  that  the  cab 
hood  was  removed.   Crossed  horizontal  and  vertical  reference 
lines  were  taped  to  the  laboratory  wall  facing  the  simulator, 
at  subject's  eye  level  and  at  a  distance  of  10  ft. 

The  reference  orientation  was  the  vertical,  and  the  op- 
erator was  instructed  to  maintain  this  orientation  for  all  the 
experiments.   No  external  input  signal  (disturbance)  was  fed 
into  the  control  loop.   Control  of  self-induced  errors  with 
unstable  controlled  elements  im.poses  sufficient  difficulty 
and  challenge  for  the  operator. 

The  simulated  controlled  element  was  of  the  form 

„    2 


2     2 


2 

representing  an  undamped  inverted  pendulum.   co  ,  took  the  dis- 
crete values  of  0.5,  1,  2,  3,  4,  and  5,  where  higher  oj,  repre- 
sents a  more  difficult  element  to  control  because  of  faster 
divergence  of  the  system.   The  gain  A   was  set  at  the  constant 
value  A    =   2,    for  all  experiments.   The  operator  exercised  ac- 
celeration control  on  the  system  with  a  light,  spring-restrained 

stick.   The  control  stick  was  linear  with  maximum  travel  of 

2  2 

±45°/sec  ,  thus  having  maximum  specific  torque  capability  {Abi,) 

2  2 

in  the  range  of  ±45°/sec   up  to  ±45  0°/sec   depending  upon  the 

system  characteristics;  greater  control  power  associated  with 

more  divergent  systems. 
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The  flight  simulator  was  driven  as  a  position  servo  about 
its  roll  axis.  ^Its  dynamics  up  to  1  cps  can  be  described  as 
a  time  delay  (e~0-ls)  ^^d  are  neglected  for  the  purpose  of 
this  investigation. 

Three  subjects  with  previous  tracking  experience  were 
used  in  these  experimental  series.   They  were  trained  in  con- 
trol of  the  simulator  in  the  visual  and  motion  mode  for  one 
half  hour  during  which  their  performance  was  monitored.   After 
reaching  a  relative  plateau  of  proficiency,  five  scoring  runs 
for  each  value  of  wg  in  ascending  order,  were  recorded.   The 
runs  were  90  sec  long,  taken  after  a  30-sec  "warm-up"  period. 
Resting  periods  of  at  least  90  sec  were  allowed  between  con- 
secutive runs  . 

Results .       The  simulator  roll  angle  (deviation  from  the 
vertical)  and  control  stick  output  (human  operator  response) 
for  each  run  were  recorded  on  magnetic  tape  and  paper  recorder. 
Inspection  of  this  data  reveals  some  obvious  characteristics 
of  the  control  loop. 

The  tracking  record  shown  in  Figure  7.2  was  taken  for 
visual  control  tracking  conditions  at  oo j  =  2 .   Changes  in 
the  divergence  frequency  or  tracking  conditions  primarily 
affect  the  error  amplitude. 

The  deviation  from  the  vertical,  shown  as  the  upper  trace 
of  the  recording,  points  to  the  fact  that  the  operator  main- 
tains good  control  of  the  system.   No  uncontrollable  diver- 
gence is  found,  and  when  excess  deviation  develops,  the  sys- 
tem can  be  brought  under  control  by  the  operator.   The  low 
frequency  oscillations  observed  are  characteristic  for  the 
loop.   This  system  behavior  is  sufficient  evidence  that  the 
human  operator  develops  compensation  needed  to  stabilize  the 
loop . 

The  operator ' s  control  movements  represented  by  the  com- 
mand accelerations  shown  in  the  lower  tracing  of  the  record 
are  of  the  bang-bang  type,  with  no  indication  of  fine  correc- 
tions around  the  zero  level,  despite  his  exercise  of  control 
through  a  linear  stick.   This  response  of  the  operator  is  of 
distinct  nonlinear  nature  resembling  the  output  of  a  relay  or 
3-mode  switch.   The  total  stick  travel  is  kept  approximately 
constant  with  controlled  element  variations,  indicating  a  line- 
arly increasing  specific  torque  related  to  oo^. 

Examination  of  the  tracking  records  is  rather  revealing. 
The  lead  compensation  capability  of  the  operator  is  well  dem- 
onstrated by  the  stability  of  the  closed  loop.   It  is  also 
noted  that  the  human  operator  is  adapting  to  the  difficult 
control  task  by  resorting  to  a  fairly  nonlinear  output.   The 
on-off  or  bang-bang  response  of  the  operator  under  these  con- 
ditions can  be  considered  an  independent  feature  of  his,  rath- 
er than  being  forced  to  use  it  by  design  of  the  controller. 


227 


-^ 


-h- 

ro  O  f^ 
+  I 


(^08S/69a) 

U0!|D>l9|e3DV 
pUDUUUUOQ 


C35 
S 

3 
o 

Co 


s 


s 

Q 


s 


H 
o 


?1 

O  ^ 

o 
I 

?^ 
o 


Qq 


(35 


c^ 


CD 
[i4 


22  8 


An  On-Off  Model  for  the  Human  Operator 

The  analog  description  of  the  human  operator  should  pre- 
serve the  nature  of  his  control  mode  (linear,  bang-bang)  along 
with  a  presentation  of  equivalent  electromechanical  networks. 
By  virtue  of  this  method,  engineering  analysis  of  loop  behavior 
will  resemble  the  actual  control  situation  in  overall  perform- 
ance and  in  addition  will  allow  simulation  of  expected  human 
response. 

In  view  of  the  control  loop  characteristics  just  dis- 
cussed, an  on-off  model  for  the  human  operator  might  be  con- 
sidered.  Since  the  major  contribution  of  the  operator  is  the 
provision  of  lead  equalization,  a  model  such  as  given  in  Fig- 
ure 7.3  may  be  a  sufficient  description  of  the  human  operator. 
Here  he  is  assigned  a  reaction  delay,  and  permitted  to  gener- 
ate lead,  but  is  restricted  to  three  output  levels.   A  remnant 
term  N (s)    accounts  for  uncertainty  in  triggering  of  the  switch. 
With  no  disturbance,  the  on-off  control  model  and  second  order 
controlled  element  are  amenable  to  analysis  in  the  phase  plane 
(144,  68).   The  representation  is  one  of  a  controller  whose  na- 
ture is  known,  but  its  associated  characteristics  (rate  compen- 
sation and  delay  time)  have  to  be  determined.   This  information 
is  provided  by  the  switching  lines,  the   locus  of  roll  angle 
and  roll  angular  velocity  (error  and  error  rate)  at  which  the 
operator  would  switch  polarity  of  his  command. 

To  use  phase  plane  for  data  analysis,  the  recorded  data 
for  each  run  was  converted  to  digital  form  and  processed  in 
an  IBM  7  094  computer  where  smoothed  error  (e)  and  error  rate 
(e)    were  computed.   An  experimental  trajectory  on  the  e-e 
plane,  picking  up  at  the  point  (-3.8,  0)  and  lasting  for  ap- 
proximately 10  sec,  is  shown  in  Figure  7.4.   Notice  the  gen- 
eral shape  of  the  trajectories  centered  about  regions  near  the 
origin  and  leading  to  a  limit  cycle  type  of  behavior. 

After  computing  the  error  and  error  rate,  the  computer 
searched  the  record  of  the  stick  position  for  sign  changes 
and  defined  those  as  switching  points.   It  was  found  that  only 
a  small  percentage  of  transitions  were  to  the  zero  level  (6  per- 
cent) ;  also  the  average  time  for  completion  of  a  transition  is 
of  the  order  of  0.4  sec.   On  the  basis  of  these  findings,  two 
assumptions  were  made  for  future  analysis:  (1)    the  human  op- 
erator behaves  like  an  ideal  relay,  and  (2)  his  characteristics 
are  described  by  a  set  of  intended  switching  lines. 

An  intended  switching  line  is  a  locus  representing  switch- 
ing points  where  the  operator  intended  to  switch  (about  0.4  sec 
before  the  actual  torque  reversal) .   If  his  control  activation 
were  that  of  an  ideal  relay,  the  control  torques  would  have 
reversed  along  this  locus.   The  intended  switching  lines  to- 
gether with  the  specific  torque  levels  completely  define  the 
model  for  the  human  operator  in  this  control  loop. 
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Figure    7.4.       Experimental    Trajectory    and   Switching   Lines 


A  least  squares  curve  fit  was  used  to  approximate  regression 
lines  in  the  second  and  fourth  quadrant  for  the  intended  switch- 
ing line  coordinates  (141).   First  order  and  second  order  poly- 
nomials of  e    and  e   were  fitted,  with  the  criteria  for  acceptance 
based  on  the  value  of  x   (chi  square)  distribution.   With  signifi- 
cance of  1  percent  or  better,  the  straight  line  regression  was 
found  to  be  sufficient  representation  of  the  intended  switching 
lines.   The  parameters  of  the  intended  switching  line,  its  slope 
and  intercept  with  the  e    axis,  are  significant  in  terms  of  the 
proposed  on-off  model  for  the  human  operator.   For  controlled  ele- 
ment dynamics  of  pure  inertia,  the  switching  lines  equation  is  (6  8) 


e  =  - 


T-^  t'^^-d 


2    -(2^^-) 


Tn^T^ry 


(31) 
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where  T]^   is  the  lead  equalization  time  constant  and  i  is  the 
dead  time  delay.   The  use  of  this  equation  is  a  justified  ap- 
proximation since  the  dynamics  of  the  loop  for  this  series  of 
experiments  resemble  those  of  a  pure  inertia  when  small  roll 
angles  are  considered.   The  intended  switching  lines  are  the 
straight  lines  shown  in  Figure  7.4.   From  these  intended  switch- 
ing lines  one  observes  that  the  operator  was  indeed  using  lead 
compensation  and  that  a  dead  time  delay  breaks  the  switching 
line  into  two  segments  which  do  not  pass  through  the  origin. 
However,  calculation  of  theoretical  trajectories  based  on  a 
switching  model  for  the  operator  requires  the  use  of  the  effec- 
tive switching  lines  rather  than  the  intended  switching  just 
discussed.   The  effective  switching  lines  are  shown  in  Figure 
7.5  and  are  computed  from  the  intended  switching  lines  by  ad- 
vancing the  switching  points  along  the  phase  portrait  by  0.4 
sec  from  the  intended  switching  lines  previously  calculated. 
This  advance  represents  the  average  distance  the  system  has 
progressed  along  its  trajectory  from  the  time  of  the  beginning 
of  a  control  transition  until  this  reversal  was  completed.   A 
theoretical  trajectory  starting  at  the  point  (-3.8,  0)  as  in 
the  experimental  trajectory  of  Figure  7.4,  and  calculated  on 
the  basis  of  the  effective  switching  lines,  is  shown,  super- 
imposed on  these  switching  lines  in  the  phase  plane,  of  Fig- 
ure 7.5.   The  resemblance  of  the  two  trajectories,  both  in 
size  of  the  approximate  limit  cycle  and  general  shape,  pro- 
vides encouraging  support  for  the  use  of  an  on-off  model  for 
the  human  operator  in  this  control  situation. 

Note  the  conceptual  difference  between  the  switching 
lines.   The  intended  switching  line  is  characteristic  of  the 
human  operator  and  his  model  representation.   It  specifies 
the  lead  equalization  time  constant  the  pilot  will  utilize 
in  a  given  control  situation.   On  the  other  hand,  the  effec- 
tive switching  line  is  a  curve  dependent  upon  the  controlled 
element  and  the  operator's  control  actions.   Due  to  an  average 
lag  in  executing  his  decision  to  reverse  polarity  of  control, 
the  pilot  will  allow  the  system  to  travel  up  to  the  effective 
switching  line  before  a  complete  torque  reversal  is  achieved. 
It  is  obvious  then  that  the  locus  of  effective  switching  points 
will  vary  with  the  dynamics  of  the  controlled  system. 

The  statistically  fitted  lines  can  be  compared  to  the 
theoretical  equation  [Eq.  (31) ]  and  values  of  lead  time  con- 
stant and  dead  time  delay  are  evaluated. 

The  mean  slope  and  the  mean  intercept  for  each  loj  and 
each  experimental  condition  were  computed  and  tested   for  one 
percent  significance  by  the  difference  of  matched  pairs  test 
(140,  141).   These  statistical  tests  were  evaluated  for  dif- 
ferent values  of  w^  under  the  same  tracking  conditions  (visu- 
al, motion,  or  combined)  and  for  similar  values  of  wj  among 
three  classes  of  control.   The  slope  of  the  intended  switching 
line,  -1/Tj-T,    is  an  indication  of  the  amount  of  lead 
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Figure    7.5.       Calculated   Phase    Portrait    and   Switching    Lines 


equalization  introduced  by  the  human  operator;  the  smaller  the 
slope,  the  larger  the  phase  lead.   The  results  of  this  computa- 
tion are  given  in  Figure  7.6.   The  value  of  x  computed  from  Eq. 
(31)  was 


0.095  <  T  <  0.11 


(32) 


for  all  the  conditions  tested  in  this  series. 

The  intended  lead  equalization  provided  by  the  human  oper- 
ator under  various  sensing  combinations  is  important  in  its 
absolute  magnitude  as  well  as  its  relative  values.   For  visual 
control,  the  trend  is  for  less  lead  compensation  with  increasing 
co^  (difficulty  of  control).   On  the  contrary,  the  vestibular- 
tactile  control  produces  more  and  more  lead,  as  needed  by  the 
system  for  an  increase  in  wj.   For  relatively  easy  controlled 
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Switching    Line    Slope    for   Control 
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elements  (wj  <  1)  the  vestibular-tactile  lead  term  is  less  than 
that  found  with  pure  visual  control.   It  might  be  expected, 
then,  that  combined  visual-motion  control  will  be  the  best 
combination  of  sensing  capabilities  both  for  low  and  high  val- 
ues of  ojj  as  is  generally  found  in  Figure  7.6. 

The  lead  equalization,  aside  from  its  requirement  for  sta- 
bilization, is  also  an  indication  of  the  expected  performance 
of  the  overall  loop.   If  rms  error  is  chosen  as  the  performance 
criterion,  the  control  with  motion  sensing  should  be  superior 
to  the  visual  one  for  difficult  control  situations  and  the  com- 
bined control  would  be  the  best  for  the  whole  range  of  diver- 
gence frequencies.   The  results  presented  in  Figure  7.7  closely 
support  the  lead  equalization  data.   It  is  found  that  for  every 
control  situation,  the  rms  error  increases  with  divergence  fre- 
quency due  to  the  increasing  difficulty  of  the  control  task. 
The  rms  errors  recorded  with  visual  control  exceed  by  far  those 
taken  for  motion  tracking,  when  the  divergence  frequency  is  in- 
creased beyond  ta^  =  1 .   With  combined  sensing,  the  human  oper- 
ator maintains  somewhat  lower  rms  error  than  that  scored  with 
the  vestibular  sensors  only,  and  is  able  to  extend  the  control- 
lable range  of  divergence  frequency  to  toj  -   2.25. 
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The  information  on  the  human  operator  provided  by  the  on- 
off  model  is  useful  in  determining  the  overall  loop  stability 
and  behavior.   In  Figure  7.2  a  limit  cycle  of  1/4  to  1/3  cps 
with  rather  constant  amplitude  of  about  1°  is  observed.   The 
theoretical  trajectory  in  Figure  7.5,  computed  for  the  same 
experimental  conditions  (visual  tracking,  u^  =  2)  points  to  a 
limit  cycle  with  parameters  similar  to  the  measured  ones.   The 
limits  of  control  reached  by  the  operator  at  high  oo^  are  pre- 
dictable too  on  the  phase  plane.   For  this  unstable  region, 
large  portions  of  the  effective  switching  lines  lie  in  the  first 
and  third  quadrant;  thus  the  operator  is  adding  energy  to  the 
system  contrary  to  the  requirements. 

Discussion 

The  series  of  experiments  just  described  were  initiated 
with  the  specific  intention  of  demonstrating  the  contribution 
of  man's  motion  sensing  abilities  in  control  of  vehicle  motion. 
The  acceleration  sensors  of  the  vestibular  system  have  been 
shown  previously  to  be  a  channel  of  information  with  a  resolu- 
tion depending  upon  the  thresholds  of  perception.   Therefore, 
the  lead  compensation  capabilities  with  vestibular  sensing 
should  be  superior  to  those  of  the  visual  system  in  which  di- 
rect sensing  of  velocity  is  a  secondary  function. 

The  experimental  results  support  the  observation  about 
the  role  of  the  vestibular  sensors  in  control  situations  where 
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the  lead  compensation  is  essential  -for  stable  closed  loop  per- 
formance.  The  rms  error,  as  a  single  scoring  indicator,  is       ^ 
also  a  significant  description  of  the  control  utilization  of      ; 
the  vestibular  sensors  by  the  operator.   For  a  system  with  low 
divergence,  the  response  is  sluggish  and  errors  often  do  not 
exceed  the  threshold  of  the  human  sensors.   The  system  error 
for  these  conditions  will  be  large  for  motion  sensing,  compared 
with  the  fine  resolution  capabilities  of  visual  control.   With 
difficult  control  tasks,  where  adequate  rate  information  is  re- 
quired, the  system  response  falls  well  within  the  frequency 
range  of  the  vestibular  sensors  and  the  operator's  control  is 
improved  as  reflected  by  the  values  of  the  rms  errors. 

The  experimental  results  merit  some  comments  on  fixed  base 
versus  moving  base  simulation.   It  was  shown  here  that  the  visu- 
al system  is  inadequate  for  vehicle  control  in  orientation  tasks 
with  high  lead  compensation  requirements.   These  systems  are 
highly  oscillatory,  they  diverge  fast  and  in  general  are  con- 
trolled, within  a  region  of  marginal  stability,  to  a  limit  cy- 
cle.  Stability  cannot  be  achieved  under  those  conditions  with- 
out adequate  rate  information.   Consequently,  control  quality 
deteriorates  rapidly  whenever  the  human  operator  is  deprived  of 
his  natural  sensation  of  motion.   According  to  the  experimental 
results  presented  here,  it  can  be  stated  that  for  missions  where 
lead  compensation  is  a  needed  control  characteristic  of  the  op- 
erator, moving  base  simulation  will  prove  to  be  an  easier  task 
and  closer  to  reality  than  fixed  base  simulation. 

The  proposed  on-off  model  for  the  human  operator  and  its 
analysis  in  the  phase  plane  demonstrate  the  potential  of  this 
approach  for  a  wide  class  of  control  situations  usually  re- 
ferred to  as  limits  of  control  of  the  operator.   The  controlled 
elements  in  these  situations  are  generally  ones  for  which  fine 
minor  control  about  the  reference  is  either  not  possible  or  not 
necessary.   Such  systems  will  typically  exhibit  a  steady  state 
limit  cycle  and  the  performance  of  the  closed  loop  is  often  de- 
termined by  the  amplitude  and  frequency  of  the  terminal  limit 
cycle.   When  a  human  operator  is  called  upon  to  control  such  an 
element,  his  task  will  correspond  to  that  of  establishing  a  limit 
cycle  which  keeps  the  error  within  allowable  bounds.   It  is  not 
surprising  therefore  to  find  that  the  human  uses  a  bang-bang 
mode  in  order  to  achieve  tight  control  of  the  system  while  per- 
mitting some  inevitable  limit  cycle.   For  the  type  of  system 
discussed  in  these  experiments,  the  limit  cycle  can  result  from 
the  subject's  inability  to  sense  the  true  reference  orientation 
accurately,  as  well  as  from  his  inability  to  make  control  correc- 
tions without  any  delay.   The  analytic  approach  described  here 
indicates  how  the  system  performance  may  be  predicted  on  the 
basis  of  an  on-off  model  for  the  operator  and  its  associated 
switching  lines  on  the  phase  plane. 
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8.  CONCLUSIONS 

The  object  of  this  thesis  was  to  investigate  the  control 
engineering  characteristics  of  the  vestibular  system  and  the 
use  of  motion  information  by  the  human  operator.   This  was  an 
effort  to  extend  the  mathematical  models  of  the  operator  to 
include  the  description  of  the  role  of  the  vestibular  sensors 
in  dynamic  space  orientation. 

A  general  model  of  the  human  operator  distinguished  among 
sensors,  control  and  compensation,  and  output.   The  thesis 
concentrated  both  on  some  "components"  of  the  human  and  some 
of  his  system  characteristics.   At  the  sensory  end,  mathematical 
models  were  presented  for  the  characteristics  of  the  vestibular 
system  and  the  eye  movement  control  system.   In  control  and 
compensation,  the  man's  non-linear  performance  and  his  control 
abilities  with  compatible  and  incompatible  multiple  inputs 
were  examined.   Finally,  in  closing  the  loop  through  the  dy- 
namics of  the  controlled  vehicle,  the  transfer  functions  of 
the  operator  with  and  without  motion  inputs  were  measured. 

The  Vestibular  System 

The  investigation  of  the  vestibular  system  was  an  effort 
to  establish  control  descriptions  of  its  sensors.  The  dynamic 
characteristics  of  the  vestibular  sensors,  the  semicircular 
canals  and  the  otoliths  were  represented  by  simple  mathemati- 
cal models.  Spatial  orientation,  as  sensed  by  the  vestibular 
system,  was  analyzed  with  respect  to  objective  motions  of  the 
vehicle. 

The  semicircular  canals  are  known  to  be  heavily  damped, 
angular  accelerometers.   Consequently,  they  respond  as  angular 
velocity  meters  over  the  frequency  range  from  0.02  cps  to  about 
1.5  cps.   The  thresholds  of  perception  of  angular  acceleration 
are  0.14°/sec2  for  rotation  about  the  Y-j^    (yaw)  axis  and  0.5°/ 
sec2  for  rotation  about  the  Z^  (roll)  axis.   A  similar  value  of 
threshold  (0.5°/sec2)  is  presumably  valid  for  rotation  about 
the  Z^  (pitch)  axis. 

The  otoliths  are  planar  linear  accelerometers  sensitive 
to  the  specific  force  applied  to  the  skull.   Statically, 
they  measure  head  orientation  with  respect  to  the  apparent 
vertical  quite  accurately.   This  sense  of  orientation  to  the 
vertical  is  modified  by  habituation  during  prolonged  stay  in 
tilted  positions.   Dynamically,  the  otoliths  function  as  linear 
velocity  meters  for  motions  with  frequencies  within  the  range 
0.016  cps  to  0.25  cps.   The  threshold  of  perception  of  linear 
accelerations  is  about  0.0059-  i^^  the  plane  of  the  otoliths. 

The  mathematical  models  for  the  semicircular  canals  and 
the  otoliths  are  summarized  in  Figure  8.1.   Each  sensor  model 
consists  of  a  linear  second  order  portion  followed  by  a  non- 
linearity  corresponding  to  the  threshold  of  perception.   This 
overall  model  of  the  vestibular  system  is  an  engineering 
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description  of  the  motion  information  perceived  by  the  human. 
A  "specification"  summary  for  the  vestibular  sensors  is  qiven 
in  Table  8.1. 


Table  8. 1 


The  Vestibular  System 

Table     8-1 
The    Vestibular     System 


Sensor 


Input  Variable 


Sensitive    Axis 


Output   Variable 


Sensor    Transfer 
Function 


Sennicircular     Canals 


Angular    Acceleration 


Sensitive    to   Angular   Accelerations 
about  an  Axis   Perpendicular  to  the 
Plane    of    the    Canals 


Subjective   Sensation   of   Angular 
Velocity,  Vestibular    Nystagmus 


Utricle 


Specific   force  in  the    Plane  of  the 
Otolith 


Sensitive  to  Accelerations    in  the 
Plane    of  the    Otolith 


Subjective  Sensation  of  Tilt   and    Linear 
Velocity  ;    Counterrolling    Eye  Movements 


H(s) 


subjective  angular  velocity 
input    angular    velocity 


Threshold    of 
Perception 


Rotation    about  the    Sagittal  Head 
Axis    Xh     (Roll) 

HxJs)    =    ~ 

"  (7s +0(0. Is -(-I) 

Rotation   about    the  Vertical    Head 
Axis     Yh    (Yaw) 

u      ,     ,         lOs 

^h  (IOs+l)(ais+l) 

Rotation   about  the  Lateral    Head 
Axis     Zh    (Pitch) 


subjective  velocity 
input    veloci  f  y 


K  s 


(I0s+I)(0.66s  +  I) 


Hzh(s)     = 


7s 


(7s  +  l)(0.ls  +  1) 


Angular    Acceleration 
a^^  =05°  /sec^ 

a  y.    =O.I4°/sec2 
°Zh  =0-5°/ sec^ 


Acceleration    in  the    Plane   of   the 
Otolith 

Oo  =0.005  g 
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The  Eye  Movement  Control  System 

Eye  movements  are  controlled  with  respect  to  a  target  or 
reference  by  a  multi-input  control  system.   A  program  of  ex- 
periments showed  that  the  horizontal  eye  movement  control  sys- 
tem stabilized  the  eye  in  the  presence  of  body  and  head  rota- 
tions.  This  stabilization  is  within  ±0.5°  for  frequencies  up 
to  2  cps.   Three  sensory  systems,  the  vestibular  system,  the 
neck  proprioceptors  and  the  eye  itself  (by  visual  tracking) , 
were  considered  to  participate  in  the  control  system.   Compen- 
satory eye  movements  were  identified  in  response  to  stimulation 
of  the  neck  proprioceptors  and  described  by  a  lag-lead  transfer 
function.   The  compensatory  eye  movements  resulting  from  neck 
proprioception  and  those  attributed  to  the  vestibular  system 
were  found  to  obey  superposition,  indicating  linearity  of  the 
control  system.   The  control  system  is  shown  to  receive  rate 
information  from  the  neck  proprioceptors  at  low  frequencies 
(up  to  0.1  cps)  and  from  the  vestibular  system  in  an  overlap- 
ping intermediate  range  of  frequencies  (0.02  cps  to  4.0  cps). 

Control  of  Vehicle  Orientation 

The  role  of  motion  inputs  to  the  human  operator  was  in- 
vestigated in  simple  vehicle  orientation  control  systems.   The 
control  characteristics  of  the  human  in  stable  and  unstable 
systems  were  compared  under  three  modes  of  operation:  visual, 
motion,  and  combined.   The  task  was  single  axis  compensatory 
orientation  of  a  vehicle  simulated  by  a  single  integration,  re- 
portedly the  optimum  dynamics  for  the  human  operator  to  control. 
Vehicle  control  to  a  reference  orientation,  by  motion  cues  only, 
was  found  impossible  with  the  sole  exception  of  control  of  ori- 
entation to  the  vertical.   In  general,  the  phase  lag  attributed 
to  the  operator  was  significantly  reduced  when  controlling  with 
motion  cues  or  combined  visual-motion  inputs,  compared  to  con- 
trol with  visual  input  only. 

The  lead  compensation  the  human  can  generate  was  also 
measured  in  a  difficult  compensatory  task  controlling  an  un- 
stable system.   The  operator's  control  characteristics  in  this 
loop  were  distinctly  nonlinear.   A  bang-bang  model  of  the  op- 
erator was  proposed  and  analyzed  in  the  phase  plane  and  used 
to  predict  experimentally  determined  limit  cycles. 

Performance  of  the  operator  with  motion  cues  shows  sig- 
nificant improvement  over  control  situations  with  visual  input 
only.   Motion  cues  extend  his  ability  to  stabilize  unstable 
systems  near  the  limit  of  controllability. 

In  summary,  the  vestibular  sensors  play  a  very  signifi- 
cant part  in  providing  rate  information  to  the  human  operator 
in  a  closed  loop  system  of  vehicle  orientation. 
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Appendix  A 
ANY-TWO-DEGREES  OF  ANGULAR  FREEDOM  MOTION  SIMULATOR 

The  NE-2  motion  simulator,  shown  in  Figure  A.l,  was  built 
by  Ames  Research  Center,  NASA.   The  moving  cab  of  the  simulator 
is  mounted  on  two  gimbals.   The  orientation  of  the  gimbals  and 
the  mounting  of  the  cab  inside  the  gimbals  may  be  varied  to  al- 
low simultaneous  rotation  of  the  cab  about  any  two  perpendicu- 
lar axes.   When  operated  as  a  single  axis  motion  simulator,  the 
inactive  gimbal  is  locked.   Each  gimbal  of  the  simulator  is 
driven  as  a  DC  position  servomechanism  by  an  electric  amplidyne- 
motor  set.   The  motion  simulator  was  modified  at  the  Man-Vehicle 
Control  Laboratory  to  adapt  it  to  the  required  angular  accelera- 
tion levels  for  studies  of  the  vestibular  system. 

The  motion  characteristics  of  the  simulator  in  the  roll- 
yaw  mode  are 

Maximum  rotation — yaw:   ±35° 

roll:  ±360° 

Maximum  angular  velocity — yaw:    2  rad/sec 

roll:   8  rad/sec 

Maximum  angular  acceleration--yaw:    10  rad/sec^ 

roll:   15  rad/sec 

Maximum  angular  acceleration  noise — yaw:   0.1°/sec  _ 

roll:  0.05°/sec 

The  dynamics  of  the  simulator  can  be  approximated  to  a 
pure  dead  time  delay,  e~^-^^    in  roll  and  e-D.15s  in  yaw.   The 
bandwidth  of  both  servo  loops  is  flat  to  2  cps. 


Appendix  B 

LINEAR  MOTION  SIMULATOR 

The  linear  motion  simulator,  built  at  MIT  (152)  ,  is  a 
carriage  which  can  be  driven  along  a  32-ft  horizontal  track. 
The  carriage  has  four  rubber  wheels  running  on  the  concrete 
laboratory  floor.   Its  lateral  movement  is  reduced  by  two  tef- 
lon runners,  which  straddle  a  guide  rail.   The  carriage  is 
driven  along  the  track  with  a  spring-loaded  continuous  steel 
cable.   The  linear  motion  simulator  is  driven  as  a  position 
servomechanism  by  a  hydraulic  valve  energizing  a  hydraulic  mo- 
tor. 

The  performance  parameters  of  the  simulator  are: 
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Maximum  travel--32  ft 

Maximum  constant  acceleration--0  .  Sg- 

Minimum  constant  acceleration  —  0.003g  to  O.OOSg' 

Bandwidth — DC  flat  to  0.9  cps 

^     .  -4-1    -0.15s 

Dynamics — approximately  e 

Lateral  and  vertical  vibrations  of  the  carriage  along  the  track 
do  not  exceed  O.Olg'. 

The  carriage  is  covered  with  a  lightproof  cardboard  struc- 
ture.  The  subject  is  seated  on  a  chair  which  can  be  adjusted 
from  90°  sitting  to  supine. 


Figure    B.2.       The    Interior    of    the    Linear   Motion    Simulator 
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Appendix  C 

ANATOMY  OF  THE  NECK— ROTATION  (76) 

Rotation  of  the  head  with  respect  to  the  trunk  is  a  co- 
ordinated effort  of  a  number  of  joints  and  muscles.   The  head 
rotates  about  a  vertical  axis  on  a  pivot  joint.   The  dens  of 
the  axis  vertebrae  are  a  pivot  around  which  the  atlas  rotates. 
These  are  the  atlanto-axial  joints  which  form  a  sealed  capsule 
containing  a  viscous  fluid  called  synovia.   The  atlanto-axial 
joints  are  three:  (I)  the  two  lateral  atlanto-axial  joints  to- 
gether with  the  ligamentum  florum  in  back  and  part  of  the 
longitudinal  ligament  in  front,  form  the  joint  cavity  which 
encloses  the  space  between  the  atlas  and  the  axis  vertebrae; 
(2)  the  median  atlanto-axial  joint  is  the  pivot  joint  between 
the  dens  of  the  axis  and  the  ring  in  the  atlas. 

Simultaneous  movement  of  all  the  three  atlanto-axial 
joints  must  occur  to  allow  the  rotation  of  the  atlas  and  the 
skull  with  it  upon  the  axis.   The  angular  travel  of  the  head 
is  limited  to  about  150°.   The  muscles  which  produce  these 
movements  are  the  Obliquus  capitus  inferior,  the  Rectus  capi- 
tus  posterior  major  and  the  Splenius  capitus  of  one  side,  act- 
ing with  the  Sternocleidomastoid  of  the  other  side.   Note  that 
rotational  motion  of  the  head  is  induced  by  three  muscles  run- 
ning along  the  back  of  the  neck,  counterbalanced  by  the  Sterno- 
cleidomastoid muscle  which  contours  the  side  of  the  neck.   The 
nerves  activating  the  muscles  involved  in  rotation  of  the  head 
branch  from  the  cervical  plexus,  and  are  believed  to  be  for 
proprioception . 


Appendix  D 

MEASUREMENT  OF  DESCRIBING  FUNCTIONS  FOR 
THE  HUMAN  OPERATOR 

The  characteristics  of  the  human  operator  in  simple  com- 
pensatory manual  control  systems  can  be  described  by  a  quasi- 
linear  describing  function  (128) .   This  approach  is  based  on 
the  notion  that  the  operator's  performance  reaches  stationary 
after  learning  the  control  task.   Since  the  inputs  to  the 
system  are  in  general  random  of  "random  appearing  functions," 
the  human  cannot  predict  their  time  pattern.   Consequently 
his  characteristics  in  these  manual  control  systems  are  as- 
sumed to  be  stationary,  when  measured  over  a  limited  period 
of  operation. 

The  quasi-linear  control  characteristics  of  the  human 
operator  consist  of  (1)    a  describing  function,  linearly  cor- 
related with  the  system  input;  and  (2)  a  remnant  which  is 
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uncorrelated  with  the  system  input.   This  description  of  the 
operator's  performance  in  compensatory  control  systems  is  one 
generally  used  and  is  analyzed  extensively  by  McRuer  and  Kren- 
del. 

The  most  common  techniques  of  describing  and  analyzing 
stationary  signals  are  by  correlation  functions  and  power 
spectral  densities.   The  power  spectral  densities  which  are 
measurable  in  a  compensatory  manual  control  system  are  the 
following: 

$  .  .  (to)  =  input  power  spectral  density 

^ oc'^^^    =  operator's  response  power  spectral  density 

^ ie  ^^^    ^   cross  power  spectral  density  of  input  and 
system  error 

*f<2^^^  =  cross  power  spectral  density  of  input  and 
operator's  response 

Since  by  definition  the  remnant  is  uncorrelated  with  the 
system  input,  one  obtains  the  following  equations: 

'ia^^^  ^  1  +  Y    (j^)y  (J.)  \i^-^  (D.l) 


*^a(")  =  1  +  7  (Jo))!  (J.)  ^i(^)  (D.2) 

p      c 

where  Y  (Jw)  =  the  describing  function  of  the  human  operator, 

and 

i'^(jw)  =  controlled  element  transfer  function. 

A  division  of  Eq.  (D.2)  by  Eq.  (D.l)  will  yield  the  describing 
function  of  the  human  operator  as: 

$  .   (co) 
\^^^^    =  ?^n^  (D.3) 

Note  the  difference  between  the  method  of  measuring  the 
operator's  describing  function  here  and  the  standard  evaluation 
of  transfer  functions  in  linear  systems.   If  the  human  did  not 
inject  a  remnant  term  N    {jui),    his  transfer  function  could  be 
measured  as : 

p  0    (to) 
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where  $    =  system  error  spectral  density  and 

ee 

0    =  cross  spectral  density  of  system  error  and  oper- 
^     ator ' s  response. 

However,  both  these  spectral  densities  contain  the  effect  of 
the  remnant  output.   Thus,  they  are  not  valid  estimates  of  the 
describing  function.   This  difficulty  is  overcome  by  cross- 
correlating  the  signals  in  the  system  with  the  input,  a  process 
which  eliminates  the  effect  of  the  uncorrelated  remnant. 

From  the  block  diagram  of  Figure  6.1  one  obtains  the  fol- 
lowing relations: 


'..(-)   -   I    1  /g  Y     I'  \i^^^   ^   I    1  /y  y     I'  \n       (D-^) 

p    c  pec 


p    e  c 


y 

^c^'^)   =    I    1  +  y  y     I'  *^^(")   +  %n(^)  (°-^) 

p    c 
where    $         (co)    =    remnant   power    spectral   density   at   the   operator's 

Q  output 

$   (w)   =  remnant  power  spectral  density  expressed  as  a 
closed  loop  quantity. 

The  relation  fl  =  y  /I  +  Y  y   is  the  closed  loop  describing  func- 
tion  of  the  operator  measured  from  system  input  to  operator's 
output.   Consequently, 

$   (oj)  =  I  ^7  I   0  .  .  +  $  (0.9) 
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Equation  (D.9)  indicates  that  the  total  operator  power 
spectra  contains  two  portions:  (2)    a  part  correlated  with 
the  system  input,  and  (2)  a  closed  loop  noise  power  injected 
in  the  system.   The  ratio  of  the  spectral  density  correlated 
with  the  system  input  to  the  total  operator  spectra  is  the 
square  of  the  linear  correlation, 

o  I     i^     I  ^    0  .  .  (cu)  $        (oj) 

=    1    -    i TTTT-  (D.IO) 


Since 


$^^((.)  $^^(0.) 


0  .  .(oo)     $        HIT  (D.12) 

^^  ec 

The  describing  function  of  the  human  operator  can  be  de- 
termined from  Eq.  (D.3).   The  correlation  coefficient   ^  -^g 
evaluated  from  Eq.  (D.12).   A  value  of   2  ^ear  unity  implies 
that  the  operator's  performance  is  well  accounted  for  by  his 
describing  function. 

The  most  frequently  used  method  of  measuring  describing 
functions  is  by  digital  computation.   In  this  method,  an  ana- 
log record  T    seconds  long  is  sampled  every  AT  seconds.   The 
correlation  function  and  the  power  spectral  density  are  deter- 
mined from  the  total  M   =  T/^T   points.   The  correlation  function 
is  evaluated  for  m    lags  of  AT.   Several  considerations  are  in- 
volved in  the  use  of  this  method. 

1.  The  sampled  data  can  have   no  spectral  power  at  fre- 
quencies above  w,  .  ,  where: 

"high  =  Tf  (D-13) 

Consequently  Wj^^  ,  has  to  be  a  frequency  above  which  the  con- 
tinuous signal  does  not  have  appreciable  power. 

2.  Since  the  spectral  density  is  evaluated  at  m   points 
equally  spaced  in  the  range  of  frequencies  0  -  w^j^  j^,  the 

frequency  resolution  of  the  digitally  computed,  power  spectral 
density  is: 

A-    ^  (D-14) 
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3.   The  probable  error  of  the  computed  spectral  density 
is  (20)  : 

2 

/ '      measured       '   _  m  (D.15) 

This  error  is  reduced  when  the  spectral  densities  are  averaged 
for  N   independent  computations : 

Equation  (D.15)  indicates  that  m    should  be  a  small  fraction  of 
M;    in  general,  use  m   =  O.lA/. 

A  program,  written  by  the  staff  of  Health  Sciences  Com- 
puting Facility,  UCLA  and  made  available  to  the  author  by  Ames 
Research  Center,  NASA,  was  used  for  the  experimental  series  re- 
ported in  section  six.   This  program  for  autocovarience  and 
power  spectral  analysis  was  modified  to  compute  the  describing 
function  of  the  human  operator  according  to  Eq.  (D.3).   The 
following  parameters  were  used  for  the  computation  procedure: 


T  =  90  sec 

T  =0.2  sec 

M  =    450   points,    e    =         JiM   ~    ^-^ 

m  =45    lags 

N  =    10 
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EDITOR'S  NOTE 

Those  readers  who  are  familiar  with  the  Proceedings  of 
the  International  Congress  on  Technology  and  Blindness  (pub- 
lished by  the  American  Foundation  for  the  Blind  in  1963)  will 
know  that  Voliome  IV  (Catalog  Appendix)  ,  issued  in  paperback 
form,  was  to  be  updated  and  reprinted  as  a  hard-cover  volume 
some  time  in  the  future  by  our  British  colleagues.   For  a 
variety  of  very  good  reasons,  this  has  proved  to  be  (as  we 
might  have  suspected)  a  good  deal  more  difficult  a  job  than 
had  first  been  anticipated.   Meanwhile,  there  is  no  adequate 
vehicle  in  our  community  of  interest  for  conveying  news  of  de- 
velopment of  instrumentation. 

In  Research    Bulletin    26,    we  initiated  the  Research  Bul- 
letin Supplement  (but,  we  were  embarrassed  to  discover,  with- 
out this  explanatory  note) .   Supplement  pages  are  perforated 
along  one  edge  so  that  they  may  be  torn  out  and  filed  accord- 
ing to  your  own  system  and  preference.   The  fonnat  of  the  Sup- 
plement resembles  that  of  the  listings  in  Volume  IV  of  the 
Proceedings,  except  that  we  have  added  photographic  information 
when  available. 

The  success  of  this  innovation  depends  on  your  reaction 
and  on  your  contribution  to  the  Supplement.   Comments  negative 
and  positive  are  welcomed  and  solicited. 

Your  attention  is  also  directed  to  the  Publications  of 
Note.   Documents  noted  belong,  as  we  believe  the  Bulletin  does, 
in  a  core  reference  for  sensory  research  related  to  sensory 
impairment. 

The  third  innovation  in  this  issue  is  the  Proposal  for 
Research  section,  described  in  the  accompanying  note. 
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PROPOSALS  FOR  RESEARCH  ON  BLINDNESS  AND  SEVERE 
VISUAL  IMPAIRMENT:    THE  SOCIAL  SCIENCES 

Editor's  Note: 

IRIS    has    received^    from    time    to    time,    requests    that    it 
disseminate    -proposals    for   research.       Some    researchers    feel    that 
such    suggestions    may    help    stimulate    the    thinking    of   themselves 
and    their    colleagues.       Others    feel    that    by   presenting    such    a 
listing    to    students    we    may    hope    to    engage    their    interest ,    eith- 
er   in    applied   research    or    in    basic    research    which    has    potential 
applications    to    what,     lately,    we    have    been    calling    "practice 
theory .  " 

The    following    suggestions    developed   from    a    free-ranging 
discussion    among    Eric   Josephson    of   the    Columbia    School    of  Pub- 
lic   Health,    Robert    A.    Scott    of   Princeton    University ,    Hyman 
Goldstein    of   the    Children' s    Bureau    of   HEW,    Milton    D.     Graham 
of   the   AFB,    and   Leslie    L.    Clark    of   IRIS/AFB.       The    focus    was    on 
social    science    research.       Additions,    suggestions,    and   criticisms 
are    solicited   from    our   readers;    we    also    propose    that    you    send 
us    suggestions    for   research    allied    to    the    physical    sciences    for 
inclusion    in    a    future    issue    of   the    Bulletin. 

1.  The  early  identification  of  genius 

2.  The  early  retardation  of  talent 

3.  The  Blindness  Register  and  the  question  of  the  "hidden 
blind" 

4.  A  cross-cultural  study  of  blindness 

5.  A  cross-subcultural  study  of  blindness 

6.  The  social  problem  of  blindness  as  determined  by  the  so- 
cial response  to  blindness 

7.  The  relationship  of  "retardation"  to  "blindness" 

8.  The  relevancies  of  basic  social  and  physical  science  theo- 
ries for  a  practice  theory  of  blindness 

9.  The  differential  consequences  of  differing  definitions  of 
blindness 


10, 


Stress,  anxiety,  and  tolerance  for  ambiguity  and  frustra- 
tion and  the  question  of  "adjustment" 


269 


Some  additional  thesis  topics,  culled  from  the  report  on 
the  196  6  International  Conference  on  Social  Work,  include: 

1.  The  consequences  of  dissolution  of  family  life  due  to  mi- 
gration and/or  urbanization 

2.  Anticipatory  studies  or  predictive  studies  of  the  life 
styles  which  the  young  can  expect  in  the  future;  and  the 
institutions  and  methods  best  suited  to  prepare  them  for 
that  future 

3.  Study  of  the  specific  social  problems  facing  children, 
and  an  analysis  of  the  causes  and  probable  effects 

4.  The  problems  in  integrating  the  programs  available  na- 
tionally and  internationally  to  benefit  youth 

5.  Studies  of  the  waste  of  natural  talent:  drop-outs  and 
stagnation 
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PUBLICATIONS  OF  NOTE 


Binoaular    Visual    Acuity    of  Adults,    by    Region    and   Selected 
Demographic    Characteristics,     United   States,    1960-1962 . 
National  Center  for  Health  Statistics,  Series  11,  Num- 
ber 25,  Public  Health  Service  Publication  No.  1000,  June, 
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RESEARCH  BULLETIN  SUPPLEMENT 


Name:    Audible  Carpenter's  Level  Study 
Source:    American  Foundation  for  the  Blind 
Availahility :    In  experimental  stage 

A  study  of  designs  for  a  new  level  has  been  initiated. 

Name:    Audible  Multimeter 

Source:    American  Foundation  for  the  Blind 

Availability :    On  request 

The  Audible  Multimeter  is  a  greatly  improved  Auditory  Cir- 
cuit Analyzer  which  allows  blind  users  to  make  a  variety  of 
electronic  and  electrical  measurements.   Accuracy  matches  that 
of  devices  used  by  sighted  persons.   A  set  of  instructions  has 
also  been  written  for  the  device. 

Name:    Harmonic  Speech  Compressor 

Source:    American  Foundation  for  the  Blind 

Availability :    Experimental  prototype 

Work  continues  on  the  construction  of  this  analyzer.   The 
remanufactured  band-pass  filters  have  been  received  from  the 
supplier. 

Name:    Improved  Tellatouch 

Source:    American  Foundation  for  the  Blind 

Availability :    Production  prototype 

Tooling  has  been  completed  for  the  improved  Tellatouch 
deaf -blind  communicator.   A  production  run  of  25  special  key- 
boards was  started  with  the  improved  device. 

Name:    Solid  State  Audio  Amplifier 

Source  :    American  Foundation  for  the  Blind 

Availability :    Experimental  prototype 

Work  continues  on  a  solid  state  amplifier  designed  for 
use  with  a  proposed  talking  book  disc  reproducer. 

Name:    Study  of  Low  Speed  Tape  Cassettes 
Source:    American  Foundation  for  the  Blind 
Availability :    In  experimental  stage 

A  study  of  low  speed  tape  cassettes  has  been  initiated. 
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Name:    Study  of  Optical  Probes 

Source:    American  Foundation  for  the  Blind 

Availability :    In  experimental  stage 

A  study  has  been  initiated  of  optical  probes  made 
thus  far,  with  the  hope  that  the  present  designs  can  be 
improved  upon.   So  far,  a  survey  of  previously  available 
designs  has  been  completed.   Further  tests  are  under  way. 

Name:    Study  of  Saw  Guides 

Source:    American  Foundation  for  the  Blind 

Availahility  :    In  experimental  stage 

A  study  has  been  initiated  of  saw  guides,  so  that 
drawings  of  these  can  be  supplied  on  request. 

Name:    Tactile  Speech  Indicator 

Source:    American  Foundation  for  the  Blind 

Availability :    Preproduction  prototype 

A  small  serial  production  of  this  device  for  deaf- 
blind  telephone  communication  was  completed;  these  will 
be  used  at  a  training  workshop. 

Name:    Tactile  Slide  Rule 

Source:    American  Foundation  for  the  Blind 

Availability :    Preprocution  prototype 

A  study  is  now  nearing  completion  of  improvements 
to  be  made  on  the  tactile  slide  rule. 

Name:    Television  Audio  Tuner  Study 
Source:    American  Foundation  for  the  Blind 
Availability :    In  experimental  stage 

An  examination  of  the  tuners  available  for  recov- 
ering the  audio  content  of  television  transmissions,  with 
the  video  content,  has  been  initiated.   One  commercial 
receiver  has  been  selected  for  close  examination. 

Name:    Closed  circuit  TV  system  for  the  visually  handi- 
capped 
Source:    The  Rand  Corporation,  Santa  Monica,  California 
Availability :    Experimental  prototype 

The  prototype  system  uses  a  TV  monitor  resting  on 
a  shelf,  a  TV  camera  with  an  electrically  operated  servo- 
mechanism  for  moving  it  about,  and  a  working  surface  to 
support  reading  and  writing  materials.   The  total  cost 
of  the  components  (commercially  available  units)  is  less 
than  $1000.   The  system  is  thought  to  be  of  potential 
value  to  any  visually  impaired  person  who  has  difficulty 
reading  and  writing  even  with  the  aid  of  glasses,  but  who 
could  carry  on  these  operations  if  he  had  the  use  of  a 
visual  aid  that  increased  magnification,  brightness,  or 
contrast,  or  some  combination  of  these. 
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Name:    Berry-Burcher  Cutting  Board 

Source:    R.  Berry,  State  Department  of  Social  Welfare, 

2516  West  Sixth  Street,  Topeka ,  Kansas 
Availability :    Upon  request 
Price:    $3.00 


A  cutting  board  12  inches  by  7-1/4  inches  by  3/4 
inch  thick  is  dadoed  along  one  side  for  insertion  of 
an  upright  wooden  "comb"  which  serves  as  a  cutting  guide 
for  blind  or  sighted  persons. 

Name:    Combination  Horn  and  Flashlight 

Source:   M.  M.  Meyers,  2918  Clinton  Street,  Fort  Worth, 

Texas  76106;  U.S.  Patent  No.  2,  893,  344 
Availability :    Experimental  prototype 

The  battery-operated  flashlight  incorporates  a 
chamber  around  the  battery  chamber  for  the  passage  of 
air  from  a  bulb-operated  air  p\amp  which  will  actuate  a 
reed  to  produce  a  honk.   The  sound  is  designed  to  alert 
pedestrians  to  the  need  for  help  by  a  blind  traveler, 
and  the  flashlight  is  designed  to  provide  illumination 
to  those  visually  impaired  persons  with  some  useful 
vision. 
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Name:  Cooking  utensil  for  visually  impaired  users 
Source:    U.S.  Patent  No.  3,405,678,  assigned  to  Tele- 

coirmiunications  Research  Associates  (Richard  E. 

Frenkel  and  Herbert  M.  Frenkel,  New  York) 
Availability:    Preproduction  prototype 

The  production  version  of  this  aid  will  have  a  han- 
dle which  can  be  used  with  a  number  of  pots  and  pans. 
The  handle  has  a  set  of  crossbars  in  a  ladder  arrange- 
ment.  The  user  starts  from  the  cold  end  and  feels  the 
crossbars  as  he  progresses  down  the  ladder  to  assess  the 
temperature  of  the  contents  of  the  pot.   The  handle  can 
be  covered  with  plastic  except  for  buttons  on  the  cross- 
bars.  The  inventors  claim  that  the  device  should  be  as 
useful  as  a  thermometer  to  a  blind  user  who  might  other- 
wise burn  himself  by  touching  a  hot  pot  cover  to  dis- 
cover how  hot  the  food  within  the   pot  has  become. 

Name:    Fieldgate  Reading  Machine 

Sourae:    Ivan  0.  Fieldgate,  Potter  Instrument  Company, 

Plainview,  Long  Island,  New  York 
Availability :    Experimental  prototype 

This  device,  awarded  U.S.  Patent  No.  3,395,24  7 
during  July,  1968,  uses  a  recorded  analogue  of  the 
braille  cell  to  generate  a  tactile  display.   Braille 
characters  are  represented  by  the  sound  code  on  magnetic 
sound  recording  tape.   A  translator  causes  flat-topped 
pins  to  be  raised  through  holes  in  a  board  for  tactile 
sensing.   The  reading  desk  has  one  fingerboard  on  which 
a  line  at  a  time  of  braille  can  be  read.   A  second 
fingerboard  shows  the  source  of  the  material,  as  do 
pages  in  a  book.   The  reader  can  regulate  the   movement 
of  the  tape  with  a  lever  to  suit  his  individual  reading 
speed. 

Name:    Nonslip  coated  goods 

Source:    Dycem,  Ltd.,  Adlams  Works,  Justice  Road,  Fish- 
ponds, Bristol,  England. 

Availability :    From  supplier 

Prices:    Pads  4/ld/  2/lOd 

Limpet  Cloth  2/6d  sq  ft 
Trays  35/6d 
Hangers  4/lld 

A  nonslip  coating  of  plastic  has  been  applied  to 
a  wide  variety  of  goods  including  pads  (rectangular, 
round),  trays  with  or  without  handles,  and  coat  and 
dress  hangers.   The  articles  are  currently  in  use  in 
occupational  therapy  centers  in  the  United  Kingdom. 
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Name:    Portable  inexpensive  radar  mobility  aid 
Source:    Bell  Telephone  Laboratories  (1968) 
Availability :    Experimental  prototype 


AUDIO 
/SMPLIFIER- 


5PEAKER 


In  a  project  to  develop  a  prototype  space  charge 
accumulation  device  (LSA) ,  J.  Copeland  and  R.  Spiwak 
built  a  five-pound,  battery-operated  radar  unit  about 
the  size  of  a  shoebox.   The  unit  consists  of  a  horn  an- 
tenna, transistorized  amplifier,  power  supply,  loud- 
speaker, and  the  diode  and  its  circuitry.   It  beams  a 
4  mw,  70  GHz  (4mm)  signal  at  objects  up  to  300  ft  away, 
and  detects  movements  of  velocities  from  0.5  ft/sec  to 
4  0  mph. 

The  transmitted  signal,  when  reflected  from  an 
object,  shifts  frequency  due  to  Doppler  effect,  then  is 
mixed  with  the  original  signal  in  the  LSA  diode.   For 
every  half  wavelength  of  distance  moved,  the  reflected 
signal  shifts  1  Hz  in  frequency.   At  the  small  wavelengths 
transmitted,  the  reflected  signal  is  therefore  in  the  au- 
dible range.   Only  4  v  and  a  few  hundred  ma  is  required; 
a  25  dB  gain  antenna  is  required  to  transmit  a  beam  width 
of  about  8  deg.   Parts  required  are  off-the-shelf,  and 
the  circuitry  is  extremely  simple. 

Bell  Laboratories  does  not  plan  to  develop  this 
device  further  as  a  mobility  aid. 
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Name:    Science  for  the  Blind  Meter  Reader 

Source:    Science  for  the  Blind,  Inc.,  221  Rock  Hill  Road, 

Bala  Cynwyd,  Pennsylvania  19004 
Availability  :    From  supplier 
Price:    $40.00 


The  Science  for  the  Blind  meter  reader  consists  of 
a  small  metal  box  with  sloping  panel,  on  which  is  located 
a  braille  scale  with  knob  and  pointer.   The  meter  reader 
may  be  connected  across  the  terminals  of  any  visual  meter 
movement  to  allow  readings  to  be  taken  by  correlating  an 
auditory  signal  with  the  braille  scale. 

The  sensitivity  of  the  reader  is  approximately  150 
mv  full  scale;  it  works  on  dc  instruments  only,  but  may  be 
adapted  for  use  with  ac  instruments  by  using  a  diode/ 


\ 
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capacitor  rectifier  unit  and  a  voltage  divider  that  has 
a  known  ratio  and  produces  less  than  150  mv  across  the 
meter  reader.   The  instrument  is  intended  primarily  for 
connection  to  the  meter  movement  of  other  measuring  in- 
struments . 

Name:    Single  channel  optical  to  tactile  aid--"Blind 

Reader" 
Source:    Dr.  Lawrence  Wainwright,  7  95  Balour  Drive,  En- 

cinitas,  California  92024 
Availability :    Experimental  prototype  being  rebuilt 
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This  device  "looks  at"  a  single  point.   A  spot  on 
the  printed  page  surface  is  illuminated  by  a  small  light 
source  and  lens  system;  it  is  also  viewed  by  a  photocell 
with  an  amplified  output.   Output  to  the  user  is  a  tac- 
tile signal  indicating  light  detection  or  no  light  detec- 
tion.  The  device  is  held  in  the  hand  with  the  axis  verti- 
cal, and  the  index  finger  tip  resting  on  a  rod  whose  move- 
ment is  actuated  by  a  solenoid  and  amplifier  within  the 
device:  the  rod  pushes  up  against  the  finger  tip  when  there 
is  no  light  detected,  and  drops  down  when  there  is  light. 
Thus  the  effect  in  "reading"  ink  print  characters  and 
figures  is  as  though  the  hand  held  a  stylus  and  used  it 
to  feel  raised  letters  and  figures. 

The  American  Foundation  for  the  Blind  seeks  the  re- 
action of  researchers  on  the  device  design,  the  human  en- 
gineering of  the  device,  and  the  psychological  assumptions 
involved  in  the  design. 
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Name:    Sondol 

Source:    Listening,  Inc.  (6  Garden  Street,  Arlington, 

Massachusetts) 
Availability :    Commercially  available 
Price:    $50.00 


This  device  is  an  echolocator  that  utilizes  some 
of  the  principles  developed  in  the  construction  of  the 
man  to  dolphin  translator  in  a  research  team  headed  (un- 
til his  death)  by  Dr.  Dwight  W.  Batteau. 

In  hand-held  use  the  device  is  directed  toward  a 
target  or  obstacle.   When  the  pulse  repetition  rate  is 
adjusted  so  that  the  returning  echo  reaches  the  user's 
ear  about  halfway  between  the  outgoing  pulses,  the  target 
itself  appears  to  emit  sound.   Blind  persons  who  have 
used  the  device  appear  to  be  able  to  make  fine  discrimina- 
tions among  target  materials  and  shapes  after  one  or  two 
hour's  practice. 

The  device  is  available  in  narrow  beam  or  wide  beam 
models,  emits  sharp  clicks  with  a  rise  time  of  50  micro- 
seconds, has  a  repetition  rate  variable  between  1/2  to 
100  pulses  per  second,  and  has  a  peak  output  of  about  10 
watts.   Modified  housings  are  available  on  special  order. 
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SVCR 

New  Listings 

Name:    Acoustic  beacon 

Source:    SVCR,  Bromina  3,  Sweden 

Availability :    Production  prototype  in  test  phase 

This  device  emits  sound  intermittently,  thus  serv- 
ing the  function  of  a  beacon  in  orienting  a  visually  im- 
paired or  blind  person  in  a  desired  direction  or  course. 

Name:    High  voltage  probe 
Source:    SVCR,  Bromma  3,  Sweden 
Availability :    In  series  production 

This  probe  detects  high  voltages  and  emits  an  au- 
dible signal  when  they  are  present. 

Name:    Survey  of  sensory  aids  needs 
Source:    SVEN/SVCR,  Bromma  3,  Sweden 

This  survey  will  attempt  to  explore  the  needs  of 
several  impaired  and  handicapped  groups  for  a  variety  of 
sensory  and  other  instrumentation  meant  to  alleviate  def- 
icits in  function  and  performance.   The  first  phase  of 
analysis  of  the  needs  of  visually  impaired  persons  is 
completed;  the  results  are  now  being  used  in  project  plan- 
ning to  meet  those  needs.   A  study  of  the  needs  of  arm 
amputees  is  now  under  way. 

Name:    Tape  recorder  control 

Source:    SVCR,  Bromma  3,  Sweden 

Availability :    Experimental  prototype  in  test  phase 

This  device  will  allow  the  operation  of  the  con- 
trols of  a  tape  recorder  with  a  puff  of  air  from  the  mouth 
or  by  easily  operated  pushbuttons. 


Revised  SVCR  Listings 

Name:    Communication  apparatus  for  the  deaf -blind 

Source:    SVCR,  Bromma  3,  Sweden 

Availability :    Work  has  been  suspended  temporarily. 

Radio-transmission  of  different  signals  to  the  deaf- 
blind  in  tactile  form. 


283 


Name:    Doorbell  with  tactile  receiving  device  for  the  deaf- 

blind 
Source:    SVCR,  Broirana  3,  Sweden 
Availability :    Production  prototype  in  preparation 

Name:    Electronic  thermometer  for  the  visually  handi- 
capped 
Source:    SVCR,  Bromma  3,  Sweden 
Availability :    Production  prototype  now  under  test 

A  thermistor  is  the  temperature-sensitive  device; 
and  an  audible  output  is  counterbalanced  to  zero  by  a 
potentiometer  at  the  correct  temperature.   Tactile  dis- 
play by  identification  of  position  of  potentiometer. 

Name:    End  position  indicator  for  braille  for  the  deaf- 
blind 
Source:    SVCR,  Bromma  3,  Sweden 
Availability :    Now  in  serial  production 

Name:    Football  for  the  visually  handicapped 

Source:    SVCR,  Bromma  3,  Sweden 

Availability :    Tests  of  laboratory  prototype  completed 

Football  with  acoustic  signal  for  use  by  blind  or 
partially  blind. 

Name:    Guiding  thread  for  the  blind 
Source:    SVCR,  Bromma  3,  Sweden 

Availability :    A  new  prototype,  with  acoustic  sensor,  now 
in  preparation  in  laboratory  prototype 

Magnetic  thread,  laid  down  at  traffic  crossings, 
alongside  pavements,  railway  platforms,  etc.   Magnetic 
field  is  picked  up  by  a  vibrator  built  into  the  ferrule 
of  a  stick,  through  which  it  is  communicated  to  a  tactile 
transmitter  at  the  handle . 

Name:    Recorded  measurement  to  speech  output  translator 

Source:    SVCR,  Bromma  3,  Sweden 

Availability :    Production  prototype  now  in  preparation 

Apparatus  for  conversion  of  recorded  measurements 
into  audible  form,  to  enable  the  visually  handicapped 
to  perform  certain  kinds  of  work. 

Name:    Recording  indicator  for  tape  recorder 

Source:    SVCR,  Bromma  3,  Sweden 

Availability :    Production  prototype  now  under  test 

Device  for  tactile  determination  of  recording  level, 
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Name:    Tactile  sensor 

Source:    SVCR,    Bromma  3,  Sweden 

Availability:    Laboratory  prototype  now  under  test 

Tactile  display  for  the  blind  or  deaf.   Two  vari- 
ants as  displayed. 

Name:    Telephone  amplifier 
Source:    SVCR,  Bromma  3,  Sweden 

Availability:    Tests  of  first  prototype  completed.   A  new 
laboratory  prototype  is  being  completed. 
Small  portable  amplifier  for  application  to  tele- 
phone receivers;  for  use  by  persons  with  defective  hear- 

Name:    Writing  aid  for  the  visually  handicapped 

Source:    SVCR,  Bromma  3,  Sweden 

Availability:    Work  has  been  suspended  temporarily 

,   .,  °^^ft  board  with  ruler  and  set  square  marked  with 
braille  signs,  together  with  special  ratchet  in  holder 
to  make  impressions  legible  from  the  top  surface 
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